2026-04-27 07:54:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-04-27 07:54:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-04-27 07:54:06 [auto1.it] INFO: Starting spider auto1.it
2026-04-27 07:54:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-04-27 07:54:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-04-27 07:54:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-04-27 07:54:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-04-27 07:54:06 [scrapy.extensions.telnet] INFO: Telnet Password: f388cae51b152a38
2026-04-27 07:54:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-04-27 07:54:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.it/2026-04-27T07_54_03.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-04-27 07:54:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:54:07 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-04-27 07:54:07 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-04-27 07:54:07 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-04-27 07:54:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-04-27 07:54:07 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:54:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2094
2026-04-27 07:54:07 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-04-27 07:54:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-04-27 07:54:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-04-27 07:54:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-04-27 07:54:10 [common.geocoding.geonames_geocoder] INFO: GeoNames geocoder loaded: 9 files, 94519 postal codes, 171568 cities
2026-04-27 07:54:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.alx.dev-cluster.alx.tech/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-04-27 07:54:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.geocoding_pipeline.GeocodingPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-04-27 07:54:10 [scrapy.core.engine] INFO: Spider opened
2026-04-27 07:54:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-04-27 07:54:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6026
2026-04-27 07:54:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 341MiB
2026-04-27 07:54:10 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:54:10 [scrapy-playwright] INFO: Starting download handler
2026-04-27 07:54:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-04-27 07:54:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:17 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-04-27 07:54:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-04-27 07:54:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-04-27 07:54:19 [auto1.it] INFO: Channel: 24h | Page: 0 | totalHits: 3091 | hits on page: 40
2026-04-27 07:54:19 [auto1.it] INFO: Found listing with ID: ZP62228
2026-04-27 07:54:19 [auto1.it] INFO: Scrape type for ZP62228: 1
2026-04-27 07:54:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [auto1.it] INFO: Found listing with ID: NV51738
2026-04-27 07:54:19 [auto1.it] INFO: Scrape type for NV51738: 1
2026-04-27 07:54:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [auto1.it] INFO: Found listing with ID: PS17327
2026-04-27 07:54:19 [auto1.it] INFO: Scrape type for PS17327: 1
2026-04-27 07:54:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [auto1.it] INFO: Found listing with ID: WA16779
2026-04-27 07:54:19 [auto1.it] INFO: Scrape type for WA16779: 1
2026-04-27 07:54:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:19 [auto1.it] INFO: Found listing with ID: SZ90719
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for SZ90719: 1
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: SZ51762
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for SZ51762: 1
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: TZ91438
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for TZ91438: 1
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: XV98790
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for XV98790: 1
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: GC36917
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for GC36917: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: PN50566
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for PN50566: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: FU47513
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for FU47513: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: GZ55251
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for GZ55251: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: DD44643
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for DD44643: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: NK41457
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for NK41457: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: NE57971
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for NE57971: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: KF95024
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for KF95024: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: YT54183
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for YT54183: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: LZ14319
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for LZ14319: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: CE32196
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for CE32196: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: XB52633
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for XB52633: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: PS52810
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for PS52810: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: WB56317
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for WB56317: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: XA44655
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for XA44655: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: AV67075
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for AV67075: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: EJ33666
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for EJ33666: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: HA87677
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for HA87677: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: UU55474
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for UU55474: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: EY12477
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for EY12477: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: EP79578
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for EP79578: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: LB81712
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for LB81712: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: FJ38839
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for FJ38839: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: KP79979
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for KP79979: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: GD17982
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for GD17982: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: AX11976
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for AX11976: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: ML57043
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for ML57043: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: NX58863
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for NX58863: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: DN32909
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for DN32909: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: AS83026
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for AS83026: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: SB47251
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for SB47251: 1
2026-04-27 07:54:20 [auto1.it] INFO: Found listing with ID: RR60550
2026-04-27 07:54:20 [auto1.it] INFO: Scrape type for RR60550: 1
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZP62228/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PS17327/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ51762/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV51738/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA16779/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [auto1.it] INFO: Channel: 24h | Page: 1 | totalHits: 3091 | hits on page: 40
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: ZP62228
2026-04-27 07:54:21 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/ZP62228/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: NV51738
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: PS17327
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: WA16779
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: SZ90719
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: SZ51762
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: TZ91438
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: XV98790
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: GC36917
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: PN50566
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: FU47513
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: GZ55251
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: DD44643
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: NK41457
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: NE57971
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: KF95024
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: YT54183
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: LZ14319
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: CE32196
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: XB52633
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: PS52810
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: WB56317
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: XA44655
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: AV67075
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: EJ33666
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: HA87677
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: UU55474
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: EY12477
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: EP79578
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: LB81712
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: FJ38839
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: KP79979
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: GD17982
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: AX11976
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: ML57043
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: NX58863
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: DN32909
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: AS83026
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: SB47251
2026-04-27 07:54:21 [auto1.it] INFO: Found listing with ID: RR60550
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV98790/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN50566/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ55251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DD44643/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GC36917/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU47513/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NE57971/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SZ90719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SB47251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK41457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AS83026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR60550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN32909/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NX58863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:23 [auto1.it] INFO: Channel: 24h | Page: 2 | totalHits: 3091 | hits on page: 40
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: LC21140
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for LC21140: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: PK70633
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for PK70633: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: NC63343
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for NC63343: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: YA50042
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for YA50042: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: XE68942
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for XE68942: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: JJ51062
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for JJ51062: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: DC87069
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for DC87069: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: AF81124
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for AF81124: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: XA32540
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for XA32540: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: CW43001
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for CW43001: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: KD09696
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for KD09696: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: YL44152
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for YL44152: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: BV24058
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for BV24058: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: NN52810
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for NN52810: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: FM11859
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for FM11859: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: DJ29164
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for DJ29164: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: AJ06383
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for AJ06383: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: SP11611
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for SP11611: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: XM57641
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for XM57641: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: MV31191
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for MV31191: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: BY24023
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for BY24023: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: JV22884
2026-04-27 07:54:23 [auto1.it] INFO: Scrape type for JV22884: 1
2026-04-27 07:54:23 [auto1.it] INFO: Found listing with ID: LZ72377
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for LZ72377: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: NV63699
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for NV63699: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: HA44632
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for HA44632: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: EX64353
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for EX64353: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: AG82147
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for AG82147: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: AG12486
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for AG12486: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: FA49150
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for FA49150: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: RY16068
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for RY16068: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: MR66716
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for MR66716: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: YV65594
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for YV65594: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: ZG15955
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for ZG15955: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: VA85498
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for VA85498: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: RR38006
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for RR38006: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: JF91368
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for JF91368: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: BR92106
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for BR92106: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: DL48698
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for DL48698: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: BF48403
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for BF48403: 1
2026-04-27 07:54:24 [auto1.it] INFO: Found listing with ID: TW78550
2026-04-27 07:54:24 [auto1.it] INFO: Scrape type for TW78550: 1
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ55251> (referer: https://www.auto1.com/v1/car-details-view/GZ55251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb98a13f-310f-5fb9-9ba9-c890ef6b921e with identifier: GZ55251
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e with scrape type 1
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_073d4aaa82f89dbdee6e310bffc340c5.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c85e03b2ce597714ae2b418c32301e48.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_60831d790f7837d98bbd1968ca698be6.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_1981ddb0c9c0733704e8a55a358b4923.jpg not downloaded yet
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU47513> (referer: https://www.auto1.com/v1/car-details-view/FU47513/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_b019e3179d969320fc9577db36a91129.jpg not downloaded yet
2026-04-27 07:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_af55ed3cf303fd87f3802b33f1b519c1.jpg not downloaded yet
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV98790> (referer: https://www.auto1.com/v1/car-details-view/XV98790/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_7445f3420c5fb13f165eb4973b3cbff3.jpg not downloaded yet
2026-04-27 07:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_e552e047e5d2b34f3a84a00825ea58b1.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_a8701eb445b93dee7311b2bc585d018a.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c3f6d310c38c0fa1266f66f1885dbf73.jpg not downloaded yet
2026-04-27 07:54:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV51738> (referer: https://www.auto1.com/v1/car-details-view/NV51738/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec934a60-5f30-5e62-837f-e02702a15a7e with identifier: FU47513
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec934a60-5f30-5e62-837f-e02702a15a7e with scrape type 1
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_c093b4bb3e2d153b4de7ca0536576be0.jpg not downloaded yet
2026-04-27 07:54:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_b8b300a7398c6661585085d7552855e8.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_05e9f2317c0d1526d19f80186b7aab50.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with identifier: XV98790
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with scrape type 1
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_9d001a42d5847107116c4691fe721045.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_bcafb8b07e04733d010a6c17ee406cba.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_2db0f88be26e40eff143ad5fe8b44944.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_9cc8d0744219a334028eb358fbda4245.png not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_08b4ad112f8c8cb7d26e6d8d8f051255.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with identifier: NV51738
2026-04-27 07:54:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with scrape type 1
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1e6565bee14e068d13d2cb7f1eda4932.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_2529dd30606342ea288333b10c39eea8.jpg not downloaded yet
2026-04-27 07:54:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_662de8cd803123273393a50ef93c706e.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_49f95f6d06f2f3f0842f02c46957743f.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_cbfac58377f35452cce62d1fee9ac90a.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ae6608801cf8d98b7ef113835bed3d5a.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_7eafffce5663019d4f3036beacc7c764.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_697decea80f808d0450ad622b30a0c11.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_f048f3376c1b65e0d5b858d8a8164d27.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_441b6a4abea3189acc0d310633c15ad6.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_13adaf698364d9f4cddc7d054676540e.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_dcd2277a4fce84954261556709f4b5da.jpg not downloaded yet
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_af55ed3cf303fd87f3802b33f1b519c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_8d44bd4544188a3d82ae7b0269c5ee3e.jpg not downloaded yet
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_1981ddb0c9c0733704e8a55a358b4923.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_614abb301aafa13cf52731ef5336d568.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ba3b9f4fab225dca7567042b1ad5d8e5.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_2a096dac2fd22a53f0b56944d0f0898b.jpg not downloaded yet
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_c093b4bb3e2d153b4de7ca0536576be0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_d0c944e9f1d66620538ac10b00b518f6.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1c22c0bb1dcb36a55caaa1af772d90c1.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ea3b6e4e65e32da45ed0f32ae3b94e77.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_10cfeb37b7457777ba887047be847c44.jpg not downloaded yet
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 36f195bf-b061-498b-bebd-997f7853af90
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2da50>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2102
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxdev.blob.core.windows.net:443
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_af55ed3cf303fd87f3802b33f1b519c1.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_0c28cc8453803a72b3cde757b1b53304.jpg not downloaded yet
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_dcd2277a4fce84954261556709f4b5da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DD44643> (referer: https://www.auto1.com/v1/car-details-view/DD44643/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59247d0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_1981ddb0c9c0733704e8a55a358b4923.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae540a010>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_c093b4bb3e2d153b4de7ca0536576be0.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_441b6a4abea3189acc0d310633c15ad6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_2a096dac2fd22a53f0b56944d0f0898b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_cdb24b7be6002294dbcd80a3814e5743.jpg not downloaded yet
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GC36917> (referer: https://www.auto1.com/v1/car-details-view/GC36917/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7c710>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_dcd2277a4fce84954261556709f4b5da.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with identifier: DD44643
2026-04-27 07:54:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with scrape type 1
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7fa628b2a2f24ecf8a4893e0cfe7720e.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d5d37db81e94d8ffdd1f178e2dbae0aa.jpg not downloaded yet
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_08200344aa4375989f7566faef88c6db.jpg not downloaded yet
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476750>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_441b6a4abea3189acc0d310633c15ad6.jpg saved to cache
2026-04-27 07:54:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593d4d0>
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_2a096dac2fd22a53f0b56944d0f0898b.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_74a45e33178a2019dd36ade4ae94cbaf.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_0c28cc8453803a72b3cde757b1b53304.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cce050c9-2e96-5954-b9e9-e970d74b7f73 with identifier: GC36917
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce050c9-2e96-5954-b9e9-e970d74b7f73 with scrape type 1
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e72c28e53417561b5828c03faa4bfe44.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_10cfeb37b7457777ba887047be847c44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_78e8e714c65ff98d02ccb679e235f2c0.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ea3b6e4e65e32da45ed0f32ae3b94e77.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_98fa36df5058b702d3302067d5fb53fb.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7a054e1428e794e616cb93798d958e1e.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_5d95e17038baf52cfb42abad521c1a12.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_3c193e9b129cab3134be54e8ad5355ec.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SB47251> (referer: https://www.auto1.com/v1/car-details-view/SB47251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e36a00550b365df8e5467b9cbdb35080.jpg not downloaded yet
2026-04-27 07:54:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7dc57f55820a460b6694969d08630ebf.jpg not downloaded yet
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632e650>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_0c28cc8453803a72b3cde757b1b53304.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_649865d01bbd28b9e98585d1d6b58b31.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e72c28e53417561b5828c03faa4bfe44.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d95fa66ca8dc0e255b112a47d30ceacb.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_74a45e33178a2019dd36ade4ae94cbaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_1205fceefad5a6fddabcec6504a7f925.jpg not downloaded yet
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59a5890>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_10cfeb37b7457777ba887047be847c44.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50910>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ea3b6e4e65e32da45ed0f32ae3b94e77.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_877bbbac43b36b9a13dbc40085a1165f.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_08200344aa4375989f7566faef88c6db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_fa42d60713d8867367871fff39e8ef4d.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1c22c0bb1dcb36a55caaa1af772d90c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_d0c944e9f1d66620538ac10b00b518f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33526747-9a53-55ed-89af-4d00fc2c2be7 with identifier: SB47251
2026-04-27 07:54:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33526747-9a53-55ed-89af-4d00fc2c2be7 with scrape type 1
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_84f9d9ebe36d852a28989d2f7ae694b4.jpg not downloaded yet
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c2690>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e72c28e53417561b5828c03faa4bfe44.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_88e4323288e7840999ed0aa9bbd61231.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_788527483b5ee4a6eb4c12b917524aab.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_2bb1c15bf4ba401c6d3e2af27190ad00.jpg not downloaded yet
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c9d10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_74a45e33178a2019dd36ade4ae94cbaf.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_51fba3e85bb69f26585c471448ac8a2e.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_ee80680642e3c77285fd5d6375b291c1.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_0c8bf9d9a91d453f0740aeb71c9c3bfb.jpg not downloaded yet
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580c190>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_08200344aa4375989f7566faef88c6db.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6583750>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1c22c0bb1dcb36a55caaa1af772d90c1.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c2f10>
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_d0c944e9f1d66620538ac10b00b518f6.jpg saved to cache
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7dc57f55820a460b6694969d08630ebf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_bc0ecc7660d7947a0c194c68823496bc.jpg not downloaded yet
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ML57043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_649865d01bbd28b9e98585d1d6b58b31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d95fa66ca8dc0e255b112a47d30ceacb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_877bbbac43b36b9a13dbc40085a1165f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_1205fceefad5a6fddabcec6504a7f925.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_ce38c0c66968f7ccd69a208ae5bfb746.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3f5b21c3fe8cd595f51e8778692ecf51.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3b77d5422c80a481530231e582c653f4.jpg not downloaded yet
2026-04-27 07:54:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_327231e2ef2203b50ba9f90c1251dc41.jpg not downloaded yet
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_3c193e9b129cab3134be54e8ad5355ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_e15ae6d59315a20b4182d42fbda7de9c.jpg not downloaded yet
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_bc0ecc7660d7947a0c194c68823496bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_51fba3e85bb69f26585c471448ac8a2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_ee80680642e3c77285fd5d6375b291c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_0c8bf9d9a91d453f0740aeb71c9c3bfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_2bb1c15bf4ba401c6d3e2af27190ad00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN50566> (referer: https://www.auto1.com/v1/car-details-view/PN50566/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AS83026> (referer: https://www.auto1.com/v1/car-details-view/AS83026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SZ90719> (referer: https://www.auto1.com/v1/car-details-view/SZ90719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR60550> (referer: https://www.auto1.com/v1/car-details-view/RR60550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c9450>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7dc57f55820a460b6694969d08630ebf.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3f450>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_649865d01bbd28b9e98585d1d6b58b31.jpg saved to cache
2026-04-27 07:54:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5866210>
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d95fa66ca8dc0e255b112a47d30ceacb.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5823450>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_877bbbac43b36b9a13dbc40085a1165f.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943cd0>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_1205fceefad5a6fddabcec6504a7f925.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN32909> (referer: https://www.auto1.com/v1/car-details-view/DN32909/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5821110>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_3c193e9b129cab3134be54e8ad5355ec.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d2d10>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_bc0ecc7660d7947a0c194c68823496bc.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a81c50>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_51fba3e85bb69f26585c471448ac8a2e.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d5c90>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_ee80680642e3c77285fd5d6375b291c1.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6311b10>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_0c8bf9d9a91d453f0740aeb71c9c3bfb.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c0ed0>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_2bb1c15bf4ba401c6d3e2af27190ad00.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f72e41f0-0ac1-549c-b4cf-f49cb688e838 with identifier: PN50566
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72e41f0-0ac1-549c-b4cf-f49cb688e838 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_42b97abec7ee59798af8acf78a4fa8e2.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with identifier: AS83026
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_14ab34f97fd8de3ed4e400023d68a2e2.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8276c57e-afe6-5598-8e93-68fc4de727bf with identifier: SZ90719
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8276c57e-afe6-5598-8e93-68fc4de727bf with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_a6cdd77346cf75a1aab5e0605b5d3a25.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39db91f5-0c9c-5999-a3be-d2d933c94324 with identifier: RR60550
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39db91f5-0c9c-5999-a3be-d2d933c94324 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_45ac8740bfed7e3ff3bad3611fc4f4c5.jpg not downloaded yet
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_327231e2ef2203b50ba9f90c1251dc41.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_84f9d9ebe36d852a28989d2f7ae694b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_ebd73d60b0cc38f5b8774eb22706528d.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_79fa18435defd5166ab8cd2fd5354944.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_fedb3fc26eb8e69830c0375b786d196c.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c88e1660f6ed95b1dc09d94b71aa9840.jpg not downloaded yet
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_788527483b5ee4a6eb4c12b917524aab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3f5b21c3fe8cd595f51e8778692ecf51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3b77d5422c80a481530231e582c653f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_ce38c0c66968f7ccd69a208ae5bfb746.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 327ab399-8085-59d3-9317-e557aeb99b30 with identifier: DN32909
2026-04-27 07:54:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327ab399-8085-59d3-9317-e557aeb99b30 with scrape type 1
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_6388263c4cb777be4a3a7b89548baf1b.jpg not downloaded yet
2026-04-27 07:54:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_88e4323288e7840999ed0aa9bbd61231.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_0973d0dbd5e669909ec5c47b8d5323c7.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_9e88d8eb5da92c621c42b380de538870.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ff5d1e90213e06ec84b7fc435b6449fc.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c4d376e759e04769f9647c16ee6f3602.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_366d94e961b869c874165071e4431fdc.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_35b891c7cb9598e8ab2c3066d30d6c47.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_b770f325f150034e56c867fe6153ff12.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_e27107904ff74ecadd77761932bd171d.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_dbb94e3b0e9b5b4fd783711b3a3dec95.jpg not downloaded yet
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a83cd0>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_327231e2ef2203b50ba9f90c1251dc41.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab9fd0>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_84f9d9ebe36d852a28989d2f7ae694b4.jpg saved to cache
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_8946e4f1b147bfaa9288367a223992e5.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_d91493d7efa62847ab7df7564a02bd0f.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_fbea0a7f6cbd33b2b7a2a0e6e0ae5c1a.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_b318bde8c4dc67c9420c1e36aaea714d.jpg not downloaded yet
2026-04-27 07:54:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_2b506c37b69d671ec4118e44810df678.jpg not downloaded yet
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487e50>
2026-04-27 07:54:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_788527483b5ee4a6eb4c12b917524aab.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596aed0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3f5b21c3fe8cd595f51e8778692ecf51.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c9d50>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3b77d5422c80a481530231e582c653f4.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5968350>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_ce38c0c66968f7ccd69a208ae5bfb746.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_fa42d60713d8867367871fff39e8ef4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_45ac8740bfed7e3ff3bad3611fc4f4c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_14ab34f97fd8de3ed4e400023d68a2e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e36a00550b365df8e5467b9cbdb35080.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_c73f2ec12a163a1b8a0e7d78d408ffae.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_5d95e17038baf52cfb42abad521c1a12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_277744008fec58b6426ca91019146645.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_285859bd1d7484a6b2175d55fc8938cc.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_46f8305ace2b27e2ace85f3bd3037adf.jpg not downloaded yet
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632cd50>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_88e4323288e7840999ed0aa9bbd61231.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_325a34a3138ac7103e02ddb3bb8a85bd.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK41457> (referer: https://www.auto1.com/v1/car-details-view/NK41457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_851dd16f072fc1dc33b422539dfb7134.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_4bf07f49146b68d52d69a3114fc7bc37.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_93713c1229c04e51d5dcda296bb24141.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_50d7fa1bcf2c9ab5ca6502fbd60b44eb.jpg not downloaded yet
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581f810>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_fa42d60713d8867367871fff39e8ef4d.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6363590>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_45ac8740bfed7e3ff3bad3611fc4f4c5.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cc2d0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_14ab34f97fd8de3ed4e400023d68a2e2.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6328750>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e36a00550b365df8e5467b9cbdb35080.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_4dd9d5752474545352092a5f94c0a84f.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_2dc03941e2c1430831a45ed423746cd2.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ec624b1d82f43e5f89c25e831b942d3a.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_dbb94e3b0e9b5b4fd783711b3a3dec95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_e15ae6d59315a20b4182d42fbda7de9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_8946e4f1b147bfaa9288367a223992e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c88e1660f6ed95b1dc09d94b71aa9840.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_7f191bc56011e1a51e6752bff0696995.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_98fa36df5058b702d3302067d5fb53fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_44d8dc774956bc4d2839c509cdae7677.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_8e3b6f84f7d8c13671b8fb2aca205188.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_d69e0dcb72ce2ff4d2cb83eefe8d151f.jpg not downloaded yet
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c98d0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_5d95e17038baf52cfb42abad521c1a12.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with identifier: NK41457
2026-04-27 07:54:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with scrape type 1
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9ed6e3de53215662b8298dfff623ef0f.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7a054e1428e794e616cb93798d958e1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_944af35533f5b50263404e47b904e124.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_123c9a5e898c0ee22e276b4fc2066a56.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_ecbef583f269fa953197280fddc6c9ac.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_9fc3cf4025a9153803fe6b365fa67a12.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_f15d08f70274a4f05f25a47bf15aff46.jpg not downloaded yet
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_04fcec1389f4d02645f19a6f67f27916.jpg not downloaded yet
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TW78550/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ML57043> (referer: https://www.auto1.com/v1/car-details-view/ML57043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586c7d0>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_dbb94e3b0e9b5b4fd783711b3a3dec95.jpg saved to cache
2026-04-27 07:54:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784c90>
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_e15ae6d59315a20b4182d42fbda7de9c.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33526747-9a53-55ed-89af-4d00fc2c2be7
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33526747-9a53-55ed-89af-4d00fc2c2be7, skipping ID generation
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33526747-9a53-55ed-89af-4d00fc2c2be7 with scrape type 1
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33526747-9a53-55ed-89af-4d00fc2c2be7 sending to next pipeline
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33526747-9a53-55ed-89af-4d00fc2c2be7, identifier: SB47251
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5940150>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_8946e4f1b147bfaa9288367a223992e5.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cee90>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c88e1660f6ed95b1dc09d94b71aa9840.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6384fd0>
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_98fa36df5058b702d3302067d5fb53fb.jpg saved to cache
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cce050c9-2e96-5954-b9e9-e970d74b7f73
2026-04-27 07:54:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cce050c9-2e96-5954-b9e9-e970d74b7f73, skipping ID generation
2026-04-27 07:54:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cce050c9-2e96-5954-b9e9-e970d74b7f73 with scrape type 1
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cce050c9-2e96-5954-b9e9-e970d74b7f73 sending to next pipeline
2026-04-27 07:54:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cce050c9-2e96-5954-b9e9-e970d74b7f73, identifier: GC36917
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_b770f325f150034e56c867fe6153ff12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_2dc03941e2c1430831a45ed423746cd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_c5ae24f5f91899f83bf6745f192ceaaf.jpg not downloaded yet
2026-04-27 07:54:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33526747-9a53-55ed-89af-4d00fc2c2be7 with identifier: SB47251
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:30 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33526747-9a53-55ed-89af-4d00fc2c2be7 with identifier: SB47251
2026-04-27 07:54:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33526747-9a53-55ed-89af-4d00fc2c2be7 with identifier: SB47251 to the API
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_e15ae6d59315a20b4182d42fbda7de9c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 194,
'expiration_date': '2026-04-28T15:10:32Z',
'fuel_type': 'hybrid',
'id': '33526747-9a53-55ed-89af-4d00fc2c2be7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SB47251',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'MG',
'model': '3',
'odometer': 23159,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_84f9d9ebe36d852a28989d2f7ae694b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_788527483b5ee4a6eb4c12b917524aab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_51fba3e85bb69f26585c471448ac8a2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_0c8bf9d9a91d453f0740aeb71c9c3bfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_bc0ecc7660d7947a0c194c68823496bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_ce38c0c66968f7ccd69a208ae5bfb746.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3f5b21c3fe8cd595f51e8778692ecf51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_3b77d5422c80a481530231e582c653f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_327231e2ef2203b50ba9f90c1251dc41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33526747-9a53-55ed-89af-4d00fc2c2be7/33526747-9a53-55ed-89af-4d00fc2c2be7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/5a/ee5ac083b9005b88962bf75a94ad26d5/pa/SB47251_e15ae6d59315a20b4182d42fbda7de9c.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'MG 3 1.5 Hybrid+ Comfort',
'transmission': 'automatic',
'trim': 'Comfort',
'year': 2025}
2026-04-27 07:54:32 [auto1.it] INFO: Saving data for SB47251: {'created_time': 1777276472.567474, 'last_price_update_time': 1777276472.567489, 'has_photos': True, 'auction_closing_time': 1777389032.0}
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cce050c9-2e96-5954-b9e9-e970d74b7f73 with identifier: GC36917
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-04-27 07:54:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-04-27 07:54:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cce050c9-2e96-5954-b9e9-e970d74b7f73 with identifier: GC36917
2026-04-27 07:54:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cce050c9-2e96-5954-b9e9-e970d74b7f73 with identifier: GC36917 to the API
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_98fa36df5058b702d3302067d5fb53fb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:02:20Z',
'fuel_type': 'diesel',
'id': 'cce050c9-2e96-5954-b9e9-e970d74b7f73',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC36917',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Punto',
'odometer': 207748,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e72c28e53417561b5828c03faa4bfe44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_98fa36df5058b702d3302067d5fb53fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 143653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_5d95e17038baf52cfb42abad521c1a12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_e36a00550b365df8e5467b9cbdb35080.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_649865d01bbd28b9e98585d1d6b58b31.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_1205fceefad5a6fddabcec6504a7f925.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_fa42d60713d8867367871fff39e8ef4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_88e4323288e7840999ed0aa9bbd61231.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_2bb1c15bf4ba401c6d3e2af27190ad00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cce050c9-2e96-5954-b9e9-e970d74b7f73/cce050c9-2e96-5954-b9e9-e970d74b7f73_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4e/c5/4ec5c48d654193a356e637c8577e3648/pa/GC36917_ee80680642e3c77285fd5d6375b291c1.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.3 JTD DPF Street',
'transmission': 'manual',
'trim': 'Street',
'year': 2014}
2026-04-27 07:54:33 [auto1.it] INFO: Saving data for GC36917: {'created_time': 1777276473.664147, 'last_price_update_time': 1777276473.66416, 'has_photos': True, 'auction_closing_time': 1777388540.0}
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_4b1c2fe71a60a2acd4aeb619966817a8.jpg not downloaded yet
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_325a34a3138ac7103e02ddb3bb8a85bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_e27107904ff74ecadd77761932bd171d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_2b506c37b69d671ec4118e44810df678.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ec624b1d82f43e5f89c25e831b942d3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_3cd6a9952a1e09681171f638c7f4ca0e.jpg not downloaded yet
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead648a250>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7a054e1428e794e616cb93798d958e1e.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a228644-4c56-5d13-b057-fa66a170251f with identifier: ML57043
2026-04-27 07:54:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a228644-4c56-5d13-b057-fa66a170251f with scrape type 1
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_b8c314c46750db319d95c5309f99db6b.jpg not downloaded yet
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d0250>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_b770f325f150034e56c867fe6153ff12.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596e350>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_2dc03941e2c1430831a45ed423746cd2.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_ee4180a1c7dbf98ee27f3ffe886676b5.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_15fa75a60b1398da516ac91abba00649.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_93713c1229c04e51d5dcda296bb24141.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_50d7fa1bcf2c9ab5ca6502fbd60b44eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d5ed0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_325a34a3138ac7103e02ddb3bb8a85bd.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c01d0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_e27107904ff74ecadd77761932bd171d.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5888610>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_2b506c37b69d671ec4118e44810df678.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead588cf90>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ec624b1d82f43e5f89c25e831b942d3a.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_4dd9d5752474545352092a5f94c0a84f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_f15d08f70274a4f05f25a47bf15aff46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_d0d2a17f9d515ebdc35f94a21ae4c8c5.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_a0fab933fce329d2d7333e6bf3c60dda.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_7f191bc56011e1a51e6752bff0696995.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_9fc3cf4025a9153803fe6b365fa67a12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_85d038f549963c5a88018e92763344ba.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_c94e2196d8038366a96e06fe4f752886.jpg not downloaded yet
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a1810>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_93713c1229c04e51d5dcda296bb24141.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cd890>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_50d7fa1bcf2c9ab5ca6502fbd60b44eb.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_ecbef583f269fa953197280fddc6c9ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9b11800bf89e0b203080165a2fd27ae7.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_d22e8ac65c0150c03b9d81f24a355c87.jpg not downloaded yet
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_8c2ab2a368016acef214855d52ab3039.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9ed6e3de53215662b8298dfff623ef0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a72bd0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_4dd9d5752474545352092a5f94c0a84f.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a709d0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_f15d08f70274a4f05f25a47bf15aff46.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65db150>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_7f191bc56011e1a51e6752bff0696995.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c0210>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_9fc3cf4025a9153803fe6b365fa67a12.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_2a3d4ce193bdfa6452d2ba1864ce33fa.jpg not downloaded yet
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_123c9a5e898c0ee22e276b4fc2066a56.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_c5ae24f5f91899f83bf6745f192ceaaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_944af35533f5b50263404e47b904e124.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_04fcec1389f4d02645f19a6f67f27916.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_b8c314c46750db319d95c5309f99db6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d1b50>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_ecbef583f269fa953197280fddc6c9ac.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63ba5d0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9ed6e3de53215662b8298dfff623ef0f.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_c94e2196d8038366a96e06fe4f752886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_d22e8ac65c0150c03b9d81f24a355c87.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_15fa75a60b1398da516ac91abba00649.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57254d0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_123c9a5e898c0ee22e276b4fc2066a56.jpg saved to cache
2026-04-27 07:54:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6591ed0>
2026-04-27 07:54:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_c5ae24f5f91899f83bf6745f192ceaaf.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58784d0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_944af35533f5b50263404e47b904e124.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6593750>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_04fcec1389f4d02645f19a6f67f27916.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_ee4180a1c7dbf98ee27f3ffe886676b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589aad0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_b8c314c46750db319d95c5309f99db6b.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_3cd6a9952a1e09681171f638c7f4ca0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_a0fab933fce329d2d7333e6bf3c60dda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642e050>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_c94e2196d8038366a96e06fe4f752886.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58992d0>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_d22e8ac65c0150c03b9d81f24a355c87.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5893a10>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_15fa75a60b1398da516ac91abba00649.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_85d038f549963c5a88018e92763344ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_a6cdd77346cf75a1aab5e0605b5d3a25.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9b11800bf89e0b203080165a2fd27ae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a99390>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_ee4180a1c7dbf98ee27f3ffe886676b5.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a70250>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_3cd6a9952a1e09681171f638c7f4ca0e.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0350>
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_a0fab933fce329d2d7333e6bf3c60dda.jpg saved to cache
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a228644-4c56-5d13-b057-fa66a170251f
2026-04-27 07:54:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a228644-4c56-5d13-b057-fa66a170251f, skipping ID generation
2026-04-27 07:54:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a228644-4c56-5d13-b057-fa66a170251f with scrape type 1
2026-04-27 07:54:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a228644-4c56-5d13-b057-fa66a170251f sending to next pipeline
2026-04-27 07:54:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a228644-4c56-5d13-b057-fa66a170251f, identifier: ML57043
2026-04-27 07:54:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_2a3d4ce193bdfa6452d2ba1864ce33fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a228644-4c56-5d13-b057-fa66a170251f with identifier: ML57043
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:35 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-04-27 07:54:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a228644-4c56-5d13-b057-fa66a170251f with identifier: ML57043
2026-04-27 07:54:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a228644-4c56-5d13-b057-fa66a170251f with identifier: ML57043 to the API
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_a0fab933fce329d2d7333e6bf3c60dda.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'city': 'Catania',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-04-28T15:30:18Z',
'fuel_type': 'petrol',
'id': '6a228644-4c56-5d13-b057-fa66a170251f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 37.4922,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ML57043',
'listing': 'auction',
'location': 'IT, Catania',
'location_confidence': 'geocoded',
'longitude': 15.0704,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 116247,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_b8c314c46750db319d95c5309f99db6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_15fa75a60b1398da516ac91abba00649.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75324,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_a0fab933fce329d2d7333e6bf3c60dda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_c94e2196d8038366a96e06fe4f752886.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a228644-4c56-5d13-b057-fa66a170251f/6a228644-4c56-5d13-b057-fa66a170251f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc3/ec/c3ec8d541f4dbf46df6dbb4b160f8667/pa/ML57043_d22e8ac65c0150c03b9d81f24a355c87.jpg',
'Width': 800}],
'postal_code': '95100',
'price': 0,
'price_includes_vat': True,
'province': 'Catania',
'province_code': 'IT-CT',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2009-04-16',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2009}
2026-04-27 07:54:36 [auto1.it] INFO: Saving data for ML57043: {'created_time': 1777276476.620801, 'last_price_update_time': 1777276476.620815, 'has_photos': True, 'auction_closing_time': 1777390218.0}
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_d0d2a17f9d515ebdc35f94a21ae4c8c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_8c2ab2a368016acef214855d52ab3039.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_8e3b6f84f7d8c13671b8fb2aca205188.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_4b1c2fe71a60a2acd4aeb619966817a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TW78550> (referer: https://www.auto1.com/v1/car-details-view/TW78550/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_d69e0dcb72ce2ff4d2cb83eefe8d151f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_44d8dc774956bc4d2839c509cdae7677.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63c4250>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_85d038f549963c5a88018e92763344ba.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5887f90>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_a6cdd77346cf75a1aab5e0605b5d3a25.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645c610>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9b11800bf89e0b203080165a2fd27ae7.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725f250>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_2a3d4ce193bdfa6452d2ba1864ce33fa.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_285859bd1d7484a6b2175d55fc8938cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_4bf07f49146b68d52d69a3114fc7bc37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_46f8305ace2b27e2ace85f3bd3037adf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_851dd16f072fc1dc33b422539dfb7134.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645f090>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_d0d2a17f9d515ebdc35f94a21ae4c8c5.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576c2d0>
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_8c2ab2a368016acef214855d52ab3039.jpg saved to cache
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa
2026-04-27 07:54:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa, skipping ID generation
2026-04-27 07:54:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with scrape type 1
2026-04-27 07:54:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a3fbc1d-d0d8-5189-9663-c137e7a347aa sending to next pipeline
2026-04-27 07:54:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa, identifier: NK41457
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b9690>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_8e3b6f84f7d8c13671b8fb2aca205188.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae592b290>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_4b1c2fe71a60a2acd4aeb619966817a8.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 218116cb-27dc-587f-8831-d71596c6c9a5 with identifier: TW78550
2026-04-27 07:54:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218116cb-27dc-587f-8831-d71596c6c9a5 with scrape type 1
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_8a7708bdf512b8f60fd74c0ac53a0ed8.jpg not downloaded yet
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576d390>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_d69e0dcb72ce2ff4d2cb83eefe8d151f.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63963d0>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_44d8dc774956bc4d2839c509cdae7677.jpg saved to cache
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with identifier: NK41457
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-04-27 07:54:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with identifier: NK41457
2026-04-27 07:54:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a3fbc1d-d0d8-5189-9663-c137e7a347aa with identifier: NK41457 to the API
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_8c2ab2a368016acef214855d52ab3039.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:29:16Z',
'fuel_type': 'petrol',
'id': '9a3fbc1d-d0d8-5189-9663-c137e7a347aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK41457',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Kia',
'model': 'Picanto',
'odometer': 41002,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9ed6e3de53215662b8298dfff623ef0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_f15d08f70274a4f05f25a47bf15aff46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59613,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_c5ae24f5f91899f83bf6745f192ceaaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_3cd6a9952a1e09681171f638c7f4ca0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_ee4180a1c7dbf98ee27f3ffe886676b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_d0d2a17f9d515ebdc35f94a21ae4c8c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_85d038f549963c5a88018e92763344ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_9b11800bf89e0b203080165a2fd27ae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_8c2ab2a368016acef214855d52ab3039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a3fbc1d-d0d8-5189-9663-c137e7a347aa/9a3fbc1d-d0d8-5189-9663-c137e7a347aa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/08/4b08bbdb1242afff1a5011e4d1fafc7d/pa/NK41457_2a3d4ce193bdfa6452d2ba1864ce33fa.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-01-15',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Picanto 1.0 Sporty Glam',
'transmission': 'manual',
'trim': 'Sporty Glam',
'year': 2015}
2026-04-27 07:54:37 [auto1.it] INFO: Saving data for NK41457: {'created_time': 1777276477.853834, 'last_price_update_time': 1777276477.853848, 'has_photos': True, 'auction_closing_time': 1777390156.0}
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_277744008fec58b6426ca91019146645.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_fbea0a7f6cbd33b2b7a2a0e6e0ae5c1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_5b3a9de07b30caa50ab10ecf2f6cb18c.jpg not downloaded yet
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_b318bde8c4dc67c9420c1e36aaea714d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_c73f2ec12a163a1b8a0e7d78d408ffae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_d91493d7efa62847ab7df7564a02bd0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_35b891c7cb9598e8ab2c3066d30d6c47.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_366d94e961b869c874165071e4431fdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_500808cec703b2242969de4d714cbf89.jpg not downloaded yet
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577e890>
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_285859bd1d7484a6b2175d55fc8938cc.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cd3d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_4bf07f49146b68d52d69a3114fc7bc37.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5835910>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_46f8305ace2b27e2ace85f3bd3037adf.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a954d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_851dd16f072fc1dc33b422539dfb7134.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_b469a0cda89a60342fb64ffb4aa37f22.jpg not downloaded yet
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_9e88d8eb5da92c621c42b380de538870.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c4d376e759e04769f9647c16ee6f3602.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ff5d1e90213e06ec84b7fc435b6449fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_06d92547707d6346dee0463eb98f2fc0.jpg not downloaded yet
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_0973d0dbd5e669909ec5c47b8d5323c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_8a7708bdf512b8f60fd74c0ac53a0ed8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_1055ec391d2dd1add3717bc46d821087.jpg not downloaded yet
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577a4d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_277744008fec58b6426ca91019146645.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a9350>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_fbea0a7f6cbd33b2b7a2a0e6e0ae5c1a.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815b90>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_b318bde8c4dc67c9420c1e36aaea714d.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a91cd0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_c73f2ec12a163a1b8a0e7d78d408ffae.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5816c90>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_d91493d7efa62847ab7df7564a02bd0f.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659bd10>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_35b891c7cb9598e8ab2c3066d30d6c47.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64d86d0>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_366d94e961b869c874165071e4431fdc.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_6388263c4cb777be4a3a7b89548baf1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_79fa18435defd5166ab8cd2fd5354944.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_49157e5b9416d6645204ea1d2f5cc610.jpg not downloaded yet
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_78e8e714c65ff98d02ccb679e235f2c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_ebd73d60b0cc38f5b8774eb22706528d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_07bab0ebed1992c4148adaba6141bb86.jpg not downloaded yet
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6337310>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_9e88d8eb5da92c621c42b380de538870.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59cb550>
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c4d376e759e04769f9647c16ee6f3602.jpg saved to cache
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39db91f5-0c9c-5999-a3be-d2d933c94324
2026-04-27 07:54:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 39db91f5-0c9c-5999-a3be-d2d933c94324, skipping ID generation
2026-04-27 07:54:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39db91f5-0c9c-5999-a3be-d2d933c94324 with scrape type 1
2026-04-27 07:54:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 39db91f5-0c9c-5999-a3be-d2d933c94324 sending to next pipeline
2026-04-27 07:54:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 39db91f5-0c9c-5999-a3be-d2d933c94324, identifier: RR60550
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead72853d0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ff5d1e90213e06ec84b7fc435b6449fc.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ae010>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_0973d0dbd5e669909ec5c47b8d5323c7.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ca390>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_8a7708bdf512b8f60fd74c0ac53a0ed8.jpg saved to cache
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_2eeb918b55f8beb28ad4893f2e7c6f70.jpg not downloaded yet
2026-04-27 07:54:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 39db91f5-0c9c-5999-a3be-d2d933c94324 with identifier: RR60550
2026-04-27 07:54:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 39db91f5-0c9c-5999-a3be-d2d933c94324 with identifier: RR60550
2026-04-27 07:54:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 39db91f5-0c9c-5999-a3be-d2d933c94324 with identifier: RR60550 to the API
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c4d376e759e04769f9647c16ee6f3602.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Cagliari',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:59:36Z',
'fuel_type': 'diesel',
'id': '39db91f5-0c9c-5999-a3be-d2d933c94324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 39.2305,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RR60550',
'listing': 'auction',
'location': 'IT, Cagliari',
'location_confidence': 'geocoded',
'longitude': 9.1192,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 203233,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_45ac8740bfed7e3ff3bad3611fc4f4c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c88e1660f6ed95b1dc09d94b71aa9840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_c4d376e759e04769f9647c16ee6f3602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_dbb94e3b0e9b5b4fd783711b3a3dec95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_39db91f5-0c9c-5999-a3be-d2d933c94324/39db91f5-0c9c-5999-a3be-d2d933c94324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/0e/970e0219b1b487df59df4e3ac0bcf33d/pa/RR60550_2b506c37b69d671ec4118e44810df678.jpg',
'Width': 800}],
'postal_code': '09100',
'price': 0,
'price_includes_vat': True,
'province': 'Cagliari',
'province_code': 'IT-CA',
'region': 'Sardegna',
'region_code': 'IT-14',
'registration_date': '2012-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.4 D-4D Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2012}
2026-04-27 07:54:39 [auto1.it] INFO: Saving data for RR60550: {'created_time': 1777276479.904483, 'last_price_update_time': 1777276479.904564, 'has_photos': True, 'auction_closing_time': 1777391976.0}
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_5b3a9de07b30caa50ab10ecf2f6cb18c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_cdb24b7be6002294dbcd80a3814e5743.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_500808cec703b2242969de4d714cbf89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_83f1efd4fec0726d0666c2b0e19c4fcd.jpg not downloaded yet
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7fa628b2a2f24ecf8a4893e0cfe7720e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d5d37db81e94d8ffdd1f178e2dbae0aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ba3b9f4fab225dca7567042b1ad5d8e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65aedd0>
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_6388263c4cb777be4a3a7b89548baf1b.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 327ab399-8085-59d3-9317-e557aeb99b30
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 327ab399-8085-59d3-9317-e557aeb99b30, skipping ID generation
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 327ab399-8085-59d3-9317-e557aeb99b30 with scrape type 1
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 327ab399-8085-59d3-9317-e557aeb99b30 sending to next pipeline
2026-04-27 07:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 327ab399-8085-59d3-9317-e557aeb99b30, identifier: DN32909
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57a86d0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_79fa18435defd5166ab8cd2fd5354944.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30
2026-04-27 07:54:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9f2ea00-17ca-556c-ac46-9a4c846cbd30, skipping ID generation
2026-04-27 07:54:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with scrape type 1
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9f2ea00-17ca-556c-ac46-9a4c846cbd30 sending to next pipeline
2026-04-27 07:54:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a9f2ea00-17ca-556c-ac46-9a4c846cbd30, identifier: AS83026
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6379e10>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_78e8e714c65ff98d02ccb679e235f2c0.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2b7d0>
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_ebd73d60b0cc38f5b8774eb22706528d.jpg saved to cache
2026-04-27 07:54:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 327ab399-8085-59d3-9317-e557aeb99b30 with identifier: DN32909
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-04-27 07:54:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 327ab399-8085-59d3-9317-e557aeb99b30 with identifier: DN32909
2026-04-27 07:54:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 327ab399-8085-59d3-9317-e557aeb99b30 with identifier: DN32909 to the API
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_6388263c4cb777be4a3a7b89548baf1b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Guidonia Monticelio',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:07:25Z',
'fuel_type': 'diesel',
'id': '327ab399-8085-59d3-9317-e557aeb99b30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.9936,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN32909',
'listing': 'auction',
'location': 'IT, Guidonia Monticelio',
'location_confidence': 'geocoded',
'longitude': 12.7224,
'make': 'Peugeot',
'model': 'Rifter',
'odometer': 248270,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_6388263c4cb777be4a3a7b89548baf1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_366d94e961b869c874165071e4431fdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_8946e4f1b147bfaa9288367a223992e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_c73f2ec12a163a1b8a0e7d78d408ffae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_325a34a3138ac7103e02ddb3bb8a85bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_50d7fa1bcf2c9ab5ca6502fbd60b44eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_7f191bc56011e1a51e6752bff0696995.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_944af35533f5b50263404e47b904e124.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_04fcec1389f4d02645f19a6f67f27916.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_327ab399-8085-59d3-9317-e557aeb99b30/327ab399-8085-59d3-9317-e557aeb99b30_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/73/1a739af69e76268badb7a07291f17e5a/pa/DN32909_4b1c2fe71a60a2acd4aeb619966817a8.jpg',
'Width': 800}],
'postal_code': '00012',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2020-06-21',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot Rifter 1.5 Blue-HDi Allure L1',
'transmission': 'manual',
'trim': 'Allure L1',
'year': 2020}
2026-04-27 07:54:40 [auto1.it] INFO: Saving data for DN32909: {'created_time': 1777276480.914581, 'last_price_update_time': 1777276480.914592, 'has_photos': True, 'auction_closing_time': 1777388845.0}
2026-04-27 07:54:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with identifier: AS83026
2026-04-27 07:54:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with identifier: AS83026
2026-04-27 07:54:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a9f2ea00-17ca-556c-ac46-9a4c846cbd30 with identifier: AS83026 to the API
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_79fa18435defd5166ab8cd2fd5354944.jpg>
{'auction_title': '',
'c_o_2_emission_value': 161,
'category': None,
'city': 'Decimomannu',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:48:23Z',
'fuel_type': 'diesel',
'id': 'a9f2ea00-17ca-556c-ac46-9a4c846cbd30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 39.3103,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS83026',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'location_confidence': 'geocoded',
'longitude': 8.9696,
'make': 'Porsche',
'model': 'Macan',
'odometer': 168371,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_14ab34f97fd8de3ed4e400023d68a2e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64773,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_79fa18435defd5166ab8cd2fd5354944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_9e88d8eb5da92c621c42b380de538870.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_b770f325f150034e56c867fe6153ff12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_fbea0a7f6cbd33b2b7a2a0e6e0ae5c1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_285859bd1d7484a6b2175d55fc8938cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_4bf07f49146b68d52d69a3114fc7bc37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_2dc03941e2c1430831a45ed423746cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_8e3b6f84f7d8c13671b8fb2aca205188.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a9f2ea00-17ca-556c-ac46-9a4c846cbd30/a9f2ea00-17ca-556c-ac46-9a4c846cbd30_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/f2/89f20cbdb64c5091f17c2afd51625347/pa/AS83026_ecbef583f269fa953197280fddc6c9ac.jpg',
'Width': 800}],
'postal_code': '09033',
'price': 0,
'price_includes_vat': True,
'province': 'Cagliari',
'province_code': 'IT-CA',
'region': 'Sardegna',
'region_code': 'IT-14',
'registration_date': '2016-02-29',
'seats_number': 5,
'seller_name': None,
'title': 'Porsche Macan S Diesel',
'transmission': 'automatic',
'trim': '',
'year': 2016}
2026-04-27 07:54:41 [auto1.it] INFO: Saving data for AS83026: {'created_time': 1777276481.274239, 'last_price_update_time': 1777276481.274256, 'has_photos': True, 'auction_closing_time': 1777391303.0}
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_06d92547707d6346dee0463eb98f2fc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_b469a0cda89a60342fb64ffb4aa37f22.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_1055ec391d2dd1add3717bc46d821087.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_49157e5b9416d6645204ea1d2f5cc610.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_614abb301aafa13cf52731ef5336d568.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_8d44bd4544188a3d82ae7b0269c5ee3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927690>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_5b3a9de07b30caa50ab10ecf2f6cb18c.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57326d0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_cdb24b7be6002294dbcd80a3814e5743.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5884a50>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_500808cec703b2242969de4d714cbf89.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f9690>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7fa628b2a2f24ecf8a4893e0cfe7720e.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63a9990>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d5d37db81e94d8ffdd1f178e2dbae0aa.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed
2026-04-27 07:54:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed, skipping ID generation
2026-04-27 07:54:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with scrape type 1
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 863d1ced-01f2-5c85-8df3-8e8d6585e4ed sending to next pipeline
2026-04-27 07:54:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed, identifier: DD44643
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1fbd0>
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ba3b9f4fab225dca7567042b1ad5d8e5.jpg saved to cache
2026-04-27 07:54:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with identifier: DD44643
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-04-27 07:54:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with identifier: DD44643
2026-04-27 07:54:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 863d1ced-01f2-5c85-8df3-8e8d6585e4ed with identifier: DD44643 to the API
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d5d37db81e94d8ffdd1f178e2dbae0aa.jpg>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'city': None,
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:35:48Z',
'fuel_type': 'diesel',
'id': '863d1ced-01f2-5c85-8df3-8e8d6585e4ed',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DD44643',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 181577,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7fa628b2a2f24ecf8a4893e0cfe7720e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d5d37db81e94d8ffdd1f178e2dbae0aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_08200344aa4375989f7566faef88c6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_74a45e33178a2019dd36ade4ae94cbaf.jpg',
'Width': 752},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_78e8e714c65ff98d02ccb679e235f2c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132055,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7a054e1428e794e616cb93798d958e1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_3c193e9b129cab3134be54e8ad5355ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_7dc57f55820a460b6694969d08630ebf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_d95fa66ca8dc0e255b112a47d30ceacb.jpg',
'Width': 770},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_863d1ced-01f2-5c85-8df3-8e8d6585e4ed/863d1ced-01f2-5c85-8df3-8e8d6585e4ed_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/13/9113d1f0f8f22f81538fa05a5951fda9/pa/DD44643_877bbbac43b36b9a13dbc40085a1165f.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2022-08-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI R-Line 4Motion',
'transmission': 'automatic',
'trim': 'R-Line 4Motion',
'year': 2022}
2026-04-27 07:54:42 [auto1.it] INFO: Saving data for DD44643: {'created_time': 1777276482.392598, 'last_price_update_time': 1777276482.392612, 'has_photos': True, 'auction_closing_time': 1777390548.0}
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_07bab0ebed1992c4148adaba6141bb86.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_2eeb918b55f8beb28ad4893f2e7c6f70.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_83f1efd4fec0726d0666c2b0e19c4fcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_13adaf698364d9f4cddc7d054676540e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589ced0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_06d92547707d6346dee0463eb98f2fc0.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6444fd0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_b469a0cda89a60342fb64ffb4aa37f22.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead648b450>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_1055ec391d2dd1add3717bc46d821087.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b6b10>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_49157e5b9416d6645204ea1d2f5cc610.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d5390>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_614abb301aafa13cf52731ef5336d568.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6489a90>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_8d44bd4544188a3d82ae7b0269c5ee3e.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_f048f3376c1b65e0d5b858d8a8164d27.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_697decea80f808d0450ad622b30a0c11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6488850>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_07bab0ebed1992c4148adaba6141bb86.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59467d0>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_2eeb918b55f8beb28ad4893f2e7c6f70.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5837110>
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_83f1efd4fec0726d0666c2b0e19c4fcd.jpg saved to cache
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 218116cb-27dc-587f-8831-d71596c6c9a5
2026-04-27 07:54:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 218116cb-27dc-587f-8831-d71596c6c9a5, skipping ID generation
2026-04-27 07:54:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 218116cb-27dc-587f-8831-d71596c6c9a5 with scrape type 1
2026-04-27 07:54:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 218116cb-27dc-587f-8831-d71596c6c9a5 sending to next pipeline
2026-04-27 07:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 218116cb-27dc-587f-8831-d71596c6c9a5, identifier: TW78550
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63c70d0>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_13adaf698364d9f4cddc7d054676540e.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_42b97abec7ee59798af8acf78a4fa8e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 218116cb-27dc-587f-8831-d71596c6c9a5 with identifier: TW78550
2026-04-27 07:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 218116cb-27dc-587f-8831-d71596c6c9a5 with identifier: TW78550
2026-04-27 07:54:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 218116cb-27dc-587f-8831-d71596c6c9a5 with identifier: TW78550 to the API
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_83f1efd4fec0726d0666c2b0e19c4fcd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 164,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:06:40Z',
'fuel_type': 'diesel',
'id': '218116cb-27dc-587f-8831-d71596c6c9a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW78550',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 90684,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_8a7708bdf512b8f60fd74c0ac53a0ed8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_5b3a9de07b30caa50ab10ecf2f6cb18c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_500808cec703b2242969de4d714cbf89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_b469a0cda89a60342fb64ffb4aa37f22.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_06d92547707d6346dee0463eb98f2fc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62123,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_1055ec391d2dd1add3717bc46d821087.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_49157e5b9416d6645204ea1d2f5cc610.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_07bab0ebed1992c4148adaba6141bb86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_2eeb918b55f8beb28ad4893f2e7c6f70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_218116cb-27dc-587f-8831-d71596c6c9a5/218116cb-27dc-587f-8831-d71596c6c9a5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge8/2f/e82fc52755cddff383e1003fd8d7529b/pa/TW78550_83f1efd4fec0726d0666c2b0e19c4fcd.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2019-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2019}
2026-04-27 07:54:43 [auto1.it] INFO: Saving data for TW78550: {'created_time': 1777276483.442909, 'last_price_update_time': 1777276483.442926, 'has_photos': True, 'auction_closing_time': 1777388800.0}
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_662de8cd803123273393a50ef93c706e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_7eafffce5663019d4f3036beacc7c764.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_49f95f6d06f2f3f0842f02c46957743f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_cbfac58377f35452cce62d1fee9ac90a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ae6608801cf8d98b7ef113835bed3d5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_2529dd30606342ea288333b10c39eea8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29150>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_f048f3376c1b65e0d5b858d8a8164d27.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b8210>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_697decea80f808d0450ad622b30a0c11.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a48810>
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_42b97abec7ee59798af8acf78a4fa8e2.jpg saved to cache
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f72e41f0-0ac1-549c-b4cf-f49cb688e838
2026-04-27 07:54:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f72e41f0-0ac1-549c-b4cf-f49cb688e838, skipping ID generation
2026-04-27 07:54:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f72e41f0-0ac1-549c-b4cf-f49cb688e838 with scrape type 1
2026-04-27 07:54:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f72e41f0-0ac1-549c-b4cf-f49cb688e838 sending to next pipeline
2026-04-27 07:54:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f72e41f0-0ac1-549c-b4cf-f49cb688e838, identifier: PN50566
2026-04-27 07:54:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f72e41f0-0ac1-549c-b4cf-f49cb688e838 with identifier: PN50566
2026-04-27 07:54:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f72e41f0-0ac1-549c-b4cf-f49cb688e838 with identifier: PN50566
2026-04-27 07:54:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f72e41f0-0ac1-549c-b4cf-f49cb688e838 with identifier: PN50566 to the API
2026-04-27 07:54:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_42b97abec7ee59798af8acf78a4fa8e2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:38:20Z',
'fuel_type': 'petrol',
'id': 'f72e41f0-0ac1-549c-b4cf-f49cb688e838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN50566',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Crossland X',
'odometer': 165380,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5441984,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_42b97abec7ee59798af8acf78a4fa8e2.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_ebd73d60b0cc38f5b8774eb22706528d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_0973d0dbd5e669909ec5c47b8d5323c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_35b891c7cb9598e8ab2c3066d30d6c47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_d91493d7efa62847ab7df7564a02bd0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_277744008fec58b6426ca91019146645.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_851dd16f072fc1dc33b422539dfb7134.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_4dd9d5752474545352092a5f94c0a84f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_44d8dc774956bc4d2839c509cdae7677.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f72e41f0-0ac1-549c-b4cf-f49cb688e838/f72e41f0-0ac1-549c-b4cf-f49cb688e838_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e6/dde645e8247db4ee360838d4d585bfc6/pa/PN50566_123c9a5e898c0ee22e276b4fc2066a56.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2019-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Crossland X 1.2 Turbo INNOVATION',
'transmission': 'manual',
'trim': 'INNOVATION',
'year': 2019}
2026-04-27 07:54:44 [auto1.it] INFO: Saving data for PN50566: {'created_time': 1777276484.244994, 'last_price_update_time': 1777276484.245009, 'has_photos': True, 'auction_closing_time': 1777390700.0}
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1e6565bee14e068d13d2cb7f1eda4932.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_2db0f88be26e40eff143ad5fe8b44944.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_08b4ad112f8c8cb7d26e6d8d8f051255.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_bcafb8b07e04733d010a6c17ee406cba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_9d001a42d5847107116c4691fe721045.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b8b90>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_662de8cd803123273393a50ef93c706e.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642f4d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_7eafffce5663019d4f3036beacc7c764.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf2785350>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_49f95f6d06f2f3f0842f02c46957743f.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58146d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_cbfac58377f35452cce62d1fee9ac90a.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580cb50>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ae6608801cf8d98b7ef113835bed3d5a.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b52d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_2529dd30606342ea288333b10c39eea8.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642dcd0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1e6565bee14e068d13d2cb7f1eda4932.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e99b5474-bdfc-5f1c-8148-5bf28ec162a3, skipping ID generation
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e99b5474-bdfc-5f1c-8148-5bf28ec162a3 sending to next pipeline
2026-04-27 07:54:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e99b5474-bdfc-5f1c-8148-5bf28ec162a3, identifier: NV51738
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65b8e50>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_2db0f88be26e40eff143ad5fe8b44944.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead595b6d0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_08b4ad112f8c8cb7d26e6d8d8f051255.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead641e250>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_bcafb8b07e04733d010a6c17ee406cba.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5988fd0>
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_9d001a42d5847107116c4691fe721045.jpg saved to cache
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada
2026-04-27 07:54:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada, skipping ID generation
2026-04-27 07:54:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with scrape type 1
2026-04-27 07:54:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33d1f7d2-54d5-5f7a-ad2e-790373f6bada sending to next pipeline
2026-04-27 07:54:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada, identifier: XV98790
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with identifier: NV51738
2026-04-27 07:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with identifier: NV51738
2026-04-27 07:54:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e99b5474-bdfc-5f1c-8148-5bf28ec162a3 with identifier: NV51738 to the API
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1e6565bee14e068d13d2cb7f1eda4932.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 197,
'expiration_date': '2026-04-28T15:30:20Z',
'fuel_type': 'hybrid',
'id': 'e99b5474-bdfc-5f1c-8148-5bf28ec162a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV51738',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'MG',
'model': 'ZS',
'odometer': 39608,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1e6565bee14e068d13d2cb7f1eda4932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_49f95f6d06f2f3f0842f02c46957743f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_7eafffce5663019d4f3036beacc7c764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_441b6a4abea3189acc0d310633c15ad6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_8d44bd4544188a3d82ae7b0269c5ee3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_2a096dac2fd22a53f0b56944d0f0898b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_1c22c0bb1dcb36a55caaa1af772d90c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_10cfeb37b7457777ba887047be847c44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_0c28cc8453803a72b3cde757b1b53304.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e99b5474-bdfc-5f1c-8148-5bf28ec162a3/e99b5474-bdfc-5f1c-8148-5bf28ec162a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/a9/57a9dd7e2cf305dec664cc38e68230db/pa/NV51738_cdb24b7be6002294dbcd80a3814e5743.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'MG ZS 1.5 T-GDI Plug-in Hybrid Luxury',
'transmission': 'automatic',
'trim': 'Luxury',
'year': 2025}
2026-04-27 07:54:45 [auto1.it] INFO: Saving data for NV51738: {'created_time': 1777276485.396088, 'last_price_update_time': 1777276485.396105, 'has_photos': True, 'auction_closing_time': 1777390220.0}
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with identifier: XV98790
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-04-27 07:54:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:54:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with identifier: XV98790
2026-04-27 07:54:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33d1f7d2-54d5-5f7a-ad2e-790373f6bada with identifier: XV98790 to the API
2026-04-27 07:54:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_9d001a42d5847107116c4691fe721045.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'category': None,
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:42:55Z',
'fuel_type': 'petrol',
'id': '33d1f7d2-54d5-5f7a-ad2e-790373f6bada',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV98790',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 168606,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_9d001a42d5847107116c4691fe721045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_2db0f88be26e40eff143ad5fe8b44944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_08b4ad112f8c8cb7d26e6d8d8f051255.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_662de8cd803123273393a50ef93c706e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ae6608801cf8d98b7ef113835bed3d5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 135163,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_f048f3376c1b65e0d5b858d8a8164d27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_dcd2277a4fce84954261556709f4b5da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ba3b9f4fab225dca7567042b1ad5d8e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_d0c944e9f1d66620538ac10b00b518f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33d1f7d2-54d5-5f7a-ad2e-790373f6bada/33d1f7d2-54d5-5f7a-ad2e-790373f6bada_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/e8/dde8b15b494b5c78cbd19f0841689595/pa/XV98790_ea3b6e4e65e32da45ed0f32ae3b94e77.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-12-21',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.4 Turbo Distinctive',
'transmission': 'automatic',
'trim': 'Distinctive',
'year': 2011}
2026-04-27 07:54:46 [auto1.it] INFO: Saving data for XV98790: {'created_time': 1777276486.875269, 'last_price_update_time': 1777276486.875283, 'has_photos': True, 'auction_closing_time': 1777390975.0}
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c3f6d310c38c0fa1266f66f1885dbf73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_a8701eb445b93dee7311b2bc585d018a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_fedb3fc26eb8e69830c0375b786d196c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_7445f3420c5fb13f165eb4973b3cbff3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_e552e047e5d2b34f3a84a00825ea58b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_b8b300a7398c6661585085d7552855e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_05e9f2317c0d1526d19f80186b7aab50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_9cc8d0744219a334028eb358fbda4245.png> (referer: https://www.auto1.com/)
2026-04-27 07:54:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_073d4aaa82f89dbdee6e310bffc340c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575c510>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c3f6d310c38c0fa1266f66f1885dbf73.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64dbc50>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_a8701eb445b93dee7311b2bc585d018a.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59e8410>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_fedb3fc26eb8e69830c0375b786d196c.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8276c57e-afe6-5598-8e93-68fc4de727bf
2026-04-27 07:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8276c57e-afe6-5598-8e93-68fc4de727bf, skipping ID generation
2026-04-27 07:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8276c57e-afe6-5598-8e93-68fc4de727bf with scrape type 1
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8276c57e-afe6-5598-8e93-68fc4de727bf sending to next pipeline
2026-04-27 07:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8276c57e-afe6-5598-8e93-68fc4de727bf, identifier: SZ90719
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2b4d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_7445f3420c5fb13f165eb4973b3cbff3.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead574d6d0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_e552e047e5d2b34f3a84a00825ea58b1.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5967290>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_b8b300a7398c6661585085d7552855e8.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ac5ed0>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_05e9f2317c0d1526d19f80186b7aab50.jpg saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'iCCP' 41 354
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: iCCP profile name b'icc'
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: Compression method 0
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 407 9
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 428 812
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1252 25
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1289 24
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1325 41
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'zTXt' 1378 37
2026-04-27 07:54:47 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 1427 8192
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dbe10>
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_4.png HTTP/1.1" 201 0
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_9cc8d0744219a334028eb358fbda4245.png saved to cache
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec934a60-5f30-5e62-837f-e02702a15a7e
2026-04-27 07:54:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec934a60-5f30-5e62-837f-e02702a15a7e, skipping ID generation
2026-04-27 07:54:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec934a60-5f30-5e62-837f-e02702a15a7e with scrape type 1
2026-04-27 07:54:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec934a60-5f30-5e62-837f-e02702a15a7e sending to next pipeline
2026-04-27 07:54:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec934a60-5f30-5e62-837f-e02702a15a7e, identifier: FU47513
2026-04-27 07:54:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8276c57e-afe6-5598-8e93-68fc4de727bf with identifier: SZ90719
2026-04-27 07:54:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8276c57e-afe6-5598-8e93-68fc4de727bf with identifier: SZ90719
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8276c57e-afe6-5598-8e93-68fc4de727bf with identifier: SZ90719 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_fedb3fc26eb8e69830c0375b786d196c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Taranto',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 218,
'expiration_date': '2026-04-28T15:37:48Z',
'fuel_type': 'hybrid',
'id': '8276c57e-afe6-5598-8e93-68fc4de727bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 40.4644,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SZ90719',
'listing': 'auction',
'location': 'IT, Taranto',
'location_confidence': 'geocoded',
'longitude': 17.2471,
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 109637,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2827095,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_a6cdd77346cf75a1aab5e0605b5d3a25.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 2568870,
'Height': 1536,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_fedb3fc26eb8e69830c0375b786d196c.jpg',
'Width': 2048},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ff5d1e90213e06ec84b7fc435b6449fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_e27107904ff74ecadd77761932bd171d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_b318bde8c4dc67c9420c1e36aaea714d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_46f8305ace2b27e2ace85f3bd3037adf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_93713c1229c04e51d5dcda296bb24141.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_ec624b1d82f43e5f89c25e831b942d3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_d69e0dcb72ce2ff4d2cb83eefe8d151f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8276c57e-afe6-5598-8e93-68fc4de727bf/8276c57e-afe6-5598-8e93-68fc4de727bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/39/1139a1a814079b00befced24e4b771ec/pa/SZ90719_9fc3cf4025a9153803fe6b365fa67a12.jpg',
'Width': 800}],
'postal_code': '74100',
'price': 0,
'price_includes_vat': True,
'province': 'Taranto',
'province_code': 'IT-TA',
'region': 'Puglia',
'region_code': 'IT-13',
'registration_date': '2022-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.5 Hybrid 4x2 Dynamic',
'transmission': 'automatic',
'trim': '4x2 Dynamic',
'year': 2022}
2026-04-27 07:54:48 [auto1.it] INFO: Saving data for SZ90719: {'created_time': 1777276488.508713, 'last_price_update_time': 1777276488.508728, 'has_photos': True, 'auction_closing_time': 1777390668.0}
2026-04-27 07:54:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec934a60-5f30-5e62-837f-e02702a15a7e with identifier: FU47513
2026-04-27 07:54:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec934a60-5f30-5e62-837f-e02702a15a7e with identifier: FU47513
2026-04-27 07:54:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec934a60-5f30-5e62-837f-e02702a15a7e with identifier: FU47513 to the API
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_9cc8d0744219a334028eb358fbda4245.png>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:30:07Z',
'fuel_type': 'diesel',
'id': 'ec934a60-5f30-5e62-837f-e02702a15a7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU47513',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'Q3',
'odometer': 256914,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_c093b4bb3e2d153b4de7ca0536576be0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_b8b300a7398c6661585085d7552855e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_05e9f2317c0d1526d19f80186b7aab50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_bcafb8b07e04733d010a6c17ee406cba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_4.png',
'Extension': 'png',
'FileSizeInBytes': 1321860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_9cc8d0744219a334028eb358fbda4245.png',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_2529dd30606342ea288333b10c39eea8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_cbfac58377f35452cce62d1fee9ac90a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 129749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_697decea80f808d0450ad622b30a0c11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_13adaf698364d9f4cddc7d054676540e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec934a60-5f30-5e62-837f-e02702a15a7e/ec934a60-5f30-5e62-837f-e02702a15a7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105781,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ff/59ffac4f030f77263dca98885c8b5813/pa/FU47513_614abb301aafa13cf52731ef5336d568.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2016-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q3 2.0 TDI quattro Business',
'transmission': 'automatic',
'trim': 'quattro Business',
'year': 2016}
2026-04-27 07:54:48 [auto1.it] INFO: Saving data for FU47513: {'created_time': 1777276488.95791, 'last_price_update_time': 1777276488.957921, 'has_photos': True, 'auction_closing_time': 1777390207.0}
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_b019e3179d969320fc9577db36a91129.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_60831d790f7837d98bbd1968ca698be6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c85e03b2ce597714ae2b418c32301e48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576af90>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_073d4aaa82f89dbdee6e310bffc340c5.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2ad10>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_b019e3179d969320fc9577db36a91129.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a916d0>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_60831d790f7837d98bbd1968ca698be6.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6394310>
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c85e03b2ce597714ae2b418c32301e48.jpg saved to cache
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e
2026-04-27 07:54:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb98a13f-310f-5fb9-9ba9-c890ef6b921e, skipping ID generation
2026-04-27 07:54:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e with scrape type 1
2026-04-27 07:54:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb98a13f-310f-5fb9-9ba9-c890ef6b921e sending to next pipeline
2026-04-27 07:54:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb98a13f-310f-5fb9-9ba9-c890ef6b921e, identifier: GZ55251
2026-04-27 07:54:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb98a13f-310f-5fb9-9ba9-c890ef6b921e with identifier: GZ55251
2026-04-27 07:54:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb98a13f-310f-5fb9-9ba9-c890ef6b921e with identifier: GZ55251
2026-04-27 07:54:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb98a13f-310f-5fb9-9ba9-c890ef6b921e with identifier: GZ55251 to the API
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c85e03b2ce597714ae2b418c32301e48.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': None,
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:06:25Z',
'fuel_type': 'petrol',
'id': 'cb98a13f-310f-5fb9-9ba9-c890ef6b921e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ55251',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'MG',
'model': '3',
'odometer': 35006,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_073d4aaa82f89dbdee6e310bffc340c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c85e03b2ce597714ae2b418c32301e48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_60831d790f7837d98bbd1968ca698be6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_1981ddb0c9c0733704e8a55a358b4923.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_b019e3179d969320fc9577db36a91129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_af55ed3cf303fd87f3802b33f1b519c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_7445f3420c5fb13f165eb4973b3cbff3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_e552e047e5d2b34f3a84a00825ea58b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_a8701eb445b93dee7311b2bc585d018a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb98a13f-310f-5fb9-9ba9-c890ef6b921e/cb98a13f-310f-5fb9-9ba9-c890ef6b921e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2a/0e/2a0e069cbfea6966efd743ed8c1bbfd6/pa/GZ55251_c3f6d310c38c0fa1266f66f1885dbf73.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2025-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'MG 3 1.5 Turbo Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2025}
2026-04-27 07:54:49 [auto1.it] INFO: Saving data for GZ55251: {'created_time': 1777276489.777036, 'last_price_update_time': 1777276489.777051, 'has_photos': True, 'auction_closing_time': 1777388785.0}
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RR38006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA85498/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF48403/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR92106/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DL48698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV65594/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZG15955/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MR66716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RY16068/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TZ91438/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FA49150/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG12486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG82147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV63699/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA44632/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EX64353/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JV22884/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BY24023/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR92106> (referer: https://www.auto1.com/v1/car-details-view/BR92106/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DL48698> (referer: https://www.auto1.com/v1/car-details-view/DL48698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ72377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV65594> (referer: https://www.auto1.com/v1/car-details-view/YV65594/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecbe5202-cf70-5829-bea0-948bd2577c9c with identifier: BR92106
2026-04-27 07:54:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbe5202-cf70-5829-bea0-948bd2577c9c with scrape type 1
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_2c5c2708fcd384f6946d81926fcf1d37.jpg not downloaded yet
2026-04-27 07:54:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_e46f62d25fa876662a2071fd493b5cec.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_809b6b0342973034744dd7636accf17d.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05993fb1-fb59-5b60-b183-766514bc4158 with identifier: DL48698
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05993fb1-fb59-5b60-b183-766514bc4158 with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_7ff4e88112d4185665f09e4b6aaa1be6.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d287ebb1ac1204fc24584087037c3b0b.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_e0c305ce514cd7e3567b0f08c1c79af3.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d49fac0297774ea10fb5086f7f4943a0.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_af94d47cbe848d19a6a0c0293b82a205.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_ee8538c8bf21d983886a3c1ec4a2dec4.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_cbff662f0f593b863bf8a676f0c9c7c4.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_708cef39ce47a26ac885fc6f3ce2ca3b.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_734048be184e3bdaa851d9ca9335a8b6.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_5c808d69bea2b6f1fa79c87de38386a5.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_614ae3f82c0f7aa63f58bb2314b705ae.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_0d11081ffbd9d8d1733f0f0b21e51f0b.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_6ef412829ef6b557ba463d2d3b3d8d50.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_f54985eab169fed6c78336de9116abef.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_5035b69d3daccc357244ba08a640e3ac.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_b5bca36ebb89388f9417cc697591e56f.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_03daae2549c9ccc14af1a0e009940376.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_a4509a64f2e6bbe3090e2f20df9e2712.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_3b6dcf28bd4fbb648e17b027cb385221.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_b2e80196947d6ed90b2f510d893537f6.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZG15955> (referer: https://www.auto1.com/v1/car-details-view/ZG15955/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_ccd9aa3a74934638cdb66bf0c6b564a2.jpg not downloaded yet
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_6fe28407158ff597c70b96db3551e32a.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c30b230-d398-518b-b458-c74d644d5567 with identifier: ZG15955
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c30b230-d398-518b-b458-c74d644d5567 with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_a43c33cc1a7ffa2dd4ec898f76a81e6e.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_22a18185f03e16bfaded19355e519010.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ee7530938237abadad0140005b19d4ba.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_245085c69b4671e9a6e155e89936fa35.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_b5269b802482303cfeb0291b5bb7a73e.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_92a86ddd2c34b8dbe831451d3cb585ff.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_b2e80196947d6ed90b2f510d893537f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ec18e3a8eb47b5a88fd527b0d4ff21b2.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_225420551947b5874083e883665148b2.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_cac5b6c18921870795f2359b89bf82e4.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_f2b29545ecdbae7e7f1acb2332d20994.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA16779> (referer: https://www.auto1.com/v1/car-details-view/WA16779/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a00510>
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_b2e80196947d6ed90b2f510d893537f6.jpg saved to cache
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MR66716> (referer: https://www.auto1.com/v1/car-details-view/MR66716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with identifier: WA16779
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_e26a54366dd5a1bbb991bd014d437f6b.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3f77354c1e5e9d840574076a876416c3.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_9767551a35ede47c4b6ec7eaccf91585.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_92a86ddd2c34b8dbe831451d3cb585ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3c1414f8939bf5654f48e2428d0a6960.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0dedeb5-e8d9-56e4-8679-99e292872f3b with identifier: MR66716
2026-04-27 07:54:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0dedeb5-e8d9-56e4-8679-99e292872f3b with scrape type 1
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_50961bf2d28915da824c60426a7b20bd.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_5049d5463d0c48898eae93209a4f8328.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_d98a378fd0e6acdaf46bd935454687b8.jpg not downloaded yet
2026-04-27 07:54:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_f2b29545ecdbae7e7f1acb2332d20994.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_c28b5acfe1b5ba59d22b6a08affa17ce.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_99408b47e03944e11fa2789a28aa38c2.jpg not downloaded yet
2026-04-27 07:54:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4164cf75a870b67f8ca1159e787d3d0e.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_cac5b6c18921870795f2359b89bf82e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TZ91438> (referer: https://www.auto1.com/v1/car-details-view/TZ91438/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_9767551a35ede47c4b6ec7eaccf91585.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4c9614eecae90a96faa12a1da4332db3.jpg not downloaded yet
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c88d0>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_92a86ddd2c34b8dbe831451d3cb585ff.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_5049d5463d0c48898eae93209a4f8328.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_291312a527ae484fc012429157339920.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead588ff90>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_f2b29545ecdbae7e7f1acb2332d20994.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_b4390b0decf2846686a0d9ffbfa86d82.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c9f90>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_cac5b6c18921870795f2359b89bf82e4.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with identifier: TZ91438
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_4c99ab0a253dc9ed84af708800c4d399.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a03690>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_9767551a35ede47c4b6ec7eaccf91585.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_7b26d755a548f4a573a50fc7b06b8d47.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_dd3bfdfcf2454e9cd1a78b107966a835.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_c28b5acfe1b5ba59d22b6a08affa17ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_2fbcdfd7e258768157665b698ddb5ae3.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5989290>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_5049d5463d0c48898eae93209a4f8328.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_55a9f2274f898ee17411029a92c88b8e.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4164cf75a870b67f8ca1159e787d3d0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_99408b47e03944e11fa2789a28aa38c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_d98a378fd0e6acdaf46bd935454687b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_32ccb36c90cd7d7608d2b52159d1f655.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59591d0>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_c28b5acfe1b5ba59d22b6a08affa17ce.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_b92208a2463d749c85a1b8168a5ac283.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG82147> (referer: https://www.auto1.com/v1/car-details-view/AG82147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927610>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4164cf75a870b67f8ca1159e787d3d0e.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead588c150>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_99408b47e03944e11fa2789a28aa38c2.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FA49150> (referer: https://www.auto1.com/v1/car-details-view/FA49150/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG12486> (referer: https://www.auto1.com/v1/car-details-view/AG12486/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RY16068> (referer: https://www.auto1.com/v1/car-details-view/RY16068/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57aa710>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_d98a378fd0e6acdaf46bd935454687b8.jpg saved to cache
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_55a9f2274f898ee17411029a92c88b8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_7b26d755a548f4a573a50fc7b06b8d47.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_dd3bfdfcf2454e9cd1a78b107966a835.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_2fbcdfd7e258768157665b698ddb5ae3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_4c99ab0a253dc9ed84af708800c4d399.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_50961bf2d28915da824c60426a7b20bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3d19105-8447-595c-bb85-063eaeee7c8a with identifier: FA49150
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d19105-8447-595c-bb85-063eaeee7c8a with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_187c867eede08c1669a89a2a5f76f14f.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20349491-f6fd-5c0e-80b6-d3150bedf530 with identifier: AG12486
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20349491-f6fd-5c0e-80b6-d3150bedf530 with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_5aaa0c8512661e6899267ea1314c12e1.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d96e79f-a6ca-5672-bb00-1243bc449b09 with identifier: RY16068
2026-04-27 07:54:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d96e79f-a6ca-5672-bb00-1243bc449b09 with scrape type 1
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_f5c51cdc7a3e143d1f48e9f084fe0b5b.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_b92208a2463d749c85a1b8168a5ac283.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_0ddbb8065e7c29931c22d2236ba8b953.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_ae06478a05371b1a0bca8b1d7131f75a.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_507310c8665089cd3733be5f7f3ef7ce.jpg not downloaded yet
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_32ccb36c90cd7d7608d2b52159d1f655.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_b4390b0decf2846686a0d9ffbfa86d82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_291312a527ae484fc012429157339920.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_fe41ef93844e69fa75631ed304bad5de.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6185b2cc2a50726acee2faebabbfa0a3.jpg not downloaded yet
2026-04-27 07:54:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4d83848a472477fee2d0f45a09099850.jpg not downloaded yet
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ed890>
2026-04-27 07:54:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_55a9f2274f898ee17411029a92c88b8e.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f7dd0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_7b26d755a548f4a573a50fc7b06b8d47.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5872b90>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_dd3bfdfcf2454e9cd1a78b107966a835.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a09d0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_2fbcdfd7e258768157665b698ddb5ae3.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f44d0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_4c99ab0a253dc9ed84af708800c4d399.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead573bf90>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_50961bf2d28915da824c60426a7b20bd.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4c9614eecae90a96faa12a1da4332db3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1c5abf0210268c9b988437e0cba4778d.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6c94ad6db3ea83ecdc3a6c4a9d29c1b5.jpg not downloaded yet
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4cf2053328a7c79895aa1cc26f98bf77.jpg not downloaded yet
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_5aaa0c8512661e6899267ea1314c12e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_f5c51cdc7a3e143d1f48e9f084fe0b5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EX64353> (referer: https://www.auto1.com/v1/car-details-view/EX64353/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA44632> (referer: https://www.auto1.com/v1/car-details-view/HA44632/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58efad0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_b92208a2463d749c85a1b8168a5ac283.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c3690>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_32ccb36c90cd7d7608d2b52159d1f655.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4
2026-04-27 07:54:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb2ac055-9359-54c2-ad3a-dbc51d3309b4, skipping ID generation
2026-04-27 07:54:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with scrape type 1
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb2ac055-9359-54c2-ad3a-dbc51d3309b4 sending to next pipeline
2026-04-27 07:54:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb2ac055-9359-54c2-ad3a-dbc51d3309b4, identifier: TZ91438
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65f8c90>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6dd0>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_b4390b0decf2846686a0d9ffbfa86d82.jpg saved to cache
2026-04-27 07:54:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6446310>
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_291312a527ae484fc012429157339920.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_187c867eede08c1669a89a2a5f76f14f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_ea4587949c269c9ae4664c499bf8d98b.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_8a35973970698c13136f844d6fb6e3c1.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_7168ebe6a82c881e68aca6d84cd29059.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with identifier: TZ91438
2026-04-27 07:54:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with identifier: TZ91438
2026-04-27 07:54:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb2ac055-9359-54c2-ad3a-dbc51d3309b4 with identifier: TZ91438 to the API
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_32ccb36c90cd7d7608d2b52159d1f655.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Bologna',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:19:50Z',
'fuel_type': 'diesel',
'id': 'cb2ac055-9359-54c2-ad3a-dbc51d3309b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.4938,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TZ91438',
'listing': 'auction',
'location': 'IT, Bologna',
'location_confidence': 'geocoded',
'longitude': 11.3387,
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 193184,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_4c99ab0a253dc9ed84af708800c4d399.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_dd3bfdfcf2454e9cd1a78b107966a835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64816,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_55a9f2274f898ee17411029a92c88b8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_32ccb36c90cd7d7608d2b52159d1f655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb2ac055-9359-54c2-ad3a-dbc51d3309b4/cb2ac055-9359-54c2-ad3a-dbc51d3309b4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60389,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/74/dd74852c0ecc7b7578abd04fc3d0aea5/pa/TZ91438_b92208a2463d749c85a1b8168a5ac283.jpg',
'Width': 800}],
'postal_code': '40100',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2011-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.6 JTDM Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2011}
2026-04-27 07:54:56 [auto1.it] INFO: Saving data for TZ91438: {'created_time': 1777276496.480046, 'last_price_update_time': 1777276496.480061, 'has_photos': True, 'auction_closing_time': 1777389590.0}
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_507310c8665089cd3733be5f7f3ef7ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_699896486368a3f9e685e27bf5d2a2d1.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_b4c2c6d961ccfcf9d3b4bfd4bd23c95f.jpg not downloaded yet
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_a7c5571eb3dbc9c20826fdcd5785e4f5.jpg not downloaded yet
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF48403> (referer: https://www.auto1.com/v1/car-details-view/BF48403/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA85498> (referer: https://www.auto1.com/v1/car-details-view/VA85498/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BY24023> (referer: https://www.auto1.com/v1/car-details-view/BY24023/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f5b10>
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4c9614eecae90a96faa12a1da4332db3.jpg saved to cache
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0dedeb5-e8d9-56e4-8679-99e292872f3b
2026-04-27 07:54:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0dedeb5-e8d9-56e4-8679-99e292872f3b, skipping ID generation
2026-04-27 07:54:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0dedeb5-e8d9-56e4-8679-99e292872f3b with scrape type 1
2026-04-27 07:54:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0dedeb5-e8d9-56e4-8679-99e292872f3b sending to next pipeline
2026-04-27 07:54:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0dedeb5-e8d9-56e4-8679-99e292872f3b, identifier: MR66716
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f88d0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_5aaa0c8512661e6899267ea1314c12e1.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ce950>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5dd0>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_f5c51cdc7a3e143d1f48e9f084fe0b5b.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57cfb10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc34d080-3e8c-55d3-b033-744a832eb719 with identifier: EX64353
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc34d080-3e8c-55d3-b033-744a832eb719 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_79d2857fa4c83335737b39bb1bcd7797.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c434968d-4fde-5397-847b-009d36ad1ba4 with identifier: HA44632
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c434968d-4fde-5397-847b-009d36ad1ba4 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_dec0daefab0ca35f3172c1ce94a5ee20.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6c94ad6db3ea83ecdc3a6c4a9d29c1b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4d83848a472477fee2d0f45a09099850.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6185b2cc2a50726acee2faebabbfa0a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_ae06478a05371b1a0bca8b1d7131f75a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_fe41ef93844e69fa75631ed304bad5de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV63699> (referer: https://www.auto1.com/v1/car-details-view/NV63699/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0dedeb5-e8d9-56e4-8679-99e292872f3b with identifier: MR66716
2026-04-27 07:54:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0dedeb5-e8d9-56e4-8679-99e292872f3b with identifier: MR66716
2026-04-27 07:54:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0dedeb5-e8d9-56e4-8679-99e292872f3b with identifier: MR66716 to the API
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4c9614eecae90a96faa12a1da4332db3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:16:21Z',
'fuel_type': 'diesel',
'id': 'd0dedeb5-e8d9-56e4-8679-99e292872f3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR66716',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Ford',
'model': 'Focus',
'odometer': 99313,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_50961bf2d28915da824c60426a7b20bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_d98a378fd0e6acdaf46bd935454687b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_c28b5acfe1b5ba59d22b6a08affa17ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_99408b47e03944e11fa2789a28aa38c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4164cf75a870b67f8ca1159e787d3d0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_4c9614eecae90a96faa12a1da4332db3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_291312a527ae484fc012429157339920.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_b4390b0decf2846686a0d9ffbfa86d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_7b26d755a548f4a573a50fc7b06b8d47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0dedeb5-e8d9-56e4-8679-99e292872f3b/d0dedeb5-e8d9-56e4-8679-99e292872f3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/f3/aef3770543ab41cee640203f8ab935c7/pa/MR66716_2fbcdfd7e258768157665b698ddb5ae3.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2018-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi EcoBlue ST-Line',
'transmission': 'automatic',
'trim': 'ST-Line',
'year': 2018}
2026-04-27 07:54:57 [auto1.it] INFO: Saving data for MR66716: {'created_time': 1777276497.713774, 'last_price_update_time': 1777276497.713786, 'has_photos': True, 'auction_closing_time': 1777389381.0}
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f5410>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b6050>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_187c867eede08c1669a89a2a5f76f14f.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4cf2053328a7c79895aa1cc26f98bf77.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_0ddbb8065e7c29931c22d2236ba8b953.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_f843ff628dfb2c7422da193480601576.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_f9ec249de74881c982e4cb6df13aaac7.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_d2e713d681e71b19bb83136572c12bb1.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ad7ed84d524ca6d4f066a3fbd5cdbe52.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_8c6f9c9e0e72afbaca5181666f904651.jpg not downloaded yet
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1c5abf0210268c9b988437e0cba4778d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JF91368/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ddd10>
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_507310c8665089cd3733be5f7f3ef7ce.jpg saved to cache
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5eee9e-aeff-5065-b05b-6092eb81aa21 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7d812d-506f-5f49-bd27-064e7059e4b7 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg not downloaded yet
2026-04-27 07:54:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with identifier: BY24023
2026-04-27 07:54:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with scrape type 1
2026-04-27 07:54:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_0e230fb44d764097eee70478c3961371.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_b144ca57b23c8190757261332452e8a1.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_cfe7077722ca3cdb0bed2107da37949e.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_97c628925e1714d60ab8eb95c389b7a2.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_9b9fd13ff2f0d5d171b1d20aed19f78a.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_3b8d1eead9259bc46a2b650d979519ee.jpg not downloaded yet
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5675150>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6c94ad6db3ea83ecdc3a6c4a9d29c1b5.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55141d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4d83848a472477fee2d0f45a09099850.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551bbd0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6185b2cc2a50726acee2faebabbfa0a3.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56787d0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_ae06478a05371b1a0bca8b1d7131f75a.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476e50>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_fe41ef93844e69fa75631ed304bad5de.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with identifier: NV63699
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with scrape type 1
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_e68296613fa19e0f0a23b5760a7c3427.jpg not downloaded yet
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_8a35973970698c13136f844d6fb6e3c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_34a664a1e66a47037d95584f68b78bed.jpg not downloaded yet
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_ea4587949c269c9ae4664c499bf8d98b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_e26a54366dd5a1bbb991bd014d437f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3f77354c1e5e9d840574076a876416c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3c1414f8939bf5654f48e2428d0a6960.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_7168ebe6a82c881e68aca6d84cd29059.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_c30e061bbe9dd9f7fc43ebdded44d46b.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_d6bdf01327366d602664c38a37fe8999.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_dd31e11198bc99641d20982b1601255e.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ec6b46f431392263d1590bb885ce25c0.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_4d8465240e48a6fafc5c67c4557165d1.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_4be29e040ea465155edfc82f59479472.jpg not downloaded yet
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57daa10>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4cf2053328a7c79895aa1cc26f98bf77.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5761ed0>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_0ddbb8065e7c29931c22d2236ba8b953.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_225420551947b5874083e883665148b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_799c232ad3a4f700dc4f3b113e97d82c.jpg not downloaded yet
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c2f90>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1c5abf0210268c9b988437e0cba4778d.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_b5269b802482303cfeb0291b5bb7a73e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ec18e3a8eb47b5a88fd527b0d4ff21b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1cb46eb576f279bbb706912e762236cc.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_7f08a4838fe08503d5043773d9236d3d.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_3e59a275a87a9e024cb9bbd755e81da8.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_659750f5c133de38b179d13696668427.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d9c79e0aa24a7820daca0fdddffddfc7.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_bfe65e273c4fe2165c0c0e8336798faf.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg not downloaded yet
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_52afb2d3396cd36ad222cefd7d347516.jpg not downloaded yet
2026-04-27 07:54:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576da50>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_8a35973970698c13136f844d6fb6e3c1.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a2590>
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg saved to cache
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df2e52db-61dc-5a76-9435-08d746d02bef
2026-04-27 07:54:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df2e52db-61dc-5a76-9435-08d746d02bef, skipping ID generation
2026-04-27 07:54:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df2e52db-61dc-5a76-9435-08d746d02bef with scrape type 1
2026-04-27 07:54:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df2e52db-61dc-5a76-9435-08d746d02bef sending to next pipeline
2026-04-27 07:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: df2e52db-61dc-5a76-9435-08d746d02bef, identifier: AG82147
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721f610>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_ea4587949c269c9ae4664c499bf8d98b.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f6150>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_e26a54366dd5a1bbb991bd014d437f6b.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a941d0>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3f77354c1e5e9d840574076a876416c3.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7d090>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3c1414f8939bf5654f48e2428d0a6960.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc
2026-04-27 07:54:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc, skipping ID generation
2026-04-27 07:54:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with scrape type 1
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1ffb5f7-379f-5e7d-b126-bd06a71d4afc sending to next pipeline
2026-04-27 07:54:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc, identifier: WA16779
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587b750>
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:54:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_7168ebe6a82c881e68aca6d84cd29059.jpg saved to cache
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_79d2857fa4c83335737b39bb1bcd7797.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_dec0daefab0ca35f3172c1ce94a5ee20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_b4c2c6d961ccfcf9d3b4bfd4bd23c95f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_83060fc1eaba94c7cde50b5bd1ffd67b.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_c0545c0cc254863b5425995515aa38d2.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_170af16696c0ac7e768b9432edcdb8a8.jpg not downloaded yet
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-04-27 07:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147
2026-04-27 07:54:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:54:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: df2e52db-61dc-5a76-9435-08d746d02bef with identifier: AG82147 to the API
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:54:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:54:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:21:12Z',
'fuel_type': 'diesel',
'id': 'df2e52db-61dc-5a76-9435-08d746d02bef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG82147',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Fiat',
'model': '500L',
'odometer': 297907,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_c88f308dee5133ea9686efaf1bbb4f2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_309ba8e37ba6cc0a4e8d5b634eead64d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_648e9fbad74f3bbd28e3029db5b1b486.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_baf8727c0d811603040f676fc6f1f096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_df2e52db-61dc-5a76-9435-08d746d02bef/df2e52db-61dc-5a76-9435-08d746d02bef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/06171d8cb3f743305f07cb856a6eaadb/pa/AG82147_5d83dd28622cf999bed76c69b51dd6f4.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2017-01-31',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2017}
2026-04-27 07:54:59 [auto1.it] INFO: Saving data for AG82147: {'created_time': 1777276499.945625, 'last_price_update_time': 1777276499.945637, 'has_photos': True, 'auction_closing_time': 1777389672.0}
2026-04-27 07:54:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with identifier: WA16779
2026-04-27 07:54:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with identifier: WA16779
2026-04-27 07:55:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a1ffb5f7-379f-5e7d-b126-bd06a71d4afc with identifier: WA16779 to the API
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3c1414f8939bf5654f48e2428d0a6960.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Imola',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:59:23Z',
'fuel_type': 'diesel',
'id': 'a1ffb5f7-379f-5e7d-b126-bd06a71d4afc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.3592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA16779',
'listing': 'auction',
'location': 'IT, Imola',
'location_confidence': 'geocoded',
'longitude': 11.7132,
'make': 'Nissan',
'model': 'X-Trail',
'odometer': 297549,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_e26a54366dd5a1bbb991bd014d437f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3f77354c1e5e9d840574076a876416c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_9767551a35ede47c4b6ec7eaccf91585.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82619,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_3c1414f8939bf5654f48e2428d0a6960.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a1ffb5f7-379f-5e7d-b126-bd06a71d4afc/a1ffb5f7-379f-5e7d-b126-bd06a71d4afc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69705,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/bf/a6bf39e375db423a3ba931b9a285352f/pa/WA16779_5049d5463d0c48898eae93209a4f8328.jpg',
'Width': 800}],
'postal_code': '40026',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2004-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan X-Trail 2.2 dCi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2004}
2026-04-27 07:55:00 [auto1.it] INFO: Saving data for WA16779: {'created_time': 1777276500.449257, 'last_price_update_time': 1777276500.449272, 'has_photos': True, 'auction_closing_time': 1777391963.0}
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_8c6f9c9e0e72afbaca5181666f904651.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_0e230fb44d764097eee70478c3961371.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a9cdd74be17dd80d1fef94ceefbf4a63.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_a7c5571eb3dbc9c20826fdcd5785e4f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_4858306048fa8e11cf85b1bba4931668.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_e3429fbf9361e1ddfdff1a174f4cc10a.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_463f2ddcdac88629fe46165b3a1a7469.jpg not downloaded yet
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b4350>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_225420551947b5874083e883665148b2.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e3990>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_b5269b802482303cfeb0291b5bb7a73e.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e3390>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ec18e3a8eb47b5a88fd527b0d4ff21b2.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_e68296613fa19e0f0a23b5760a7c3427.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_8ef1f419fac0eed02060447e49856a85.jpg not downloaded yet
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_9b9fd13ff2f0d5d171b1d20aed19f78a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_577d23e6f2f5fdf28ba61e1248b7baaa.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_1d04974c1c7f2f9e59eb5fe4e951da62.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_858800154ed84bdc0e21e1531a8d8a9b.jpg not downloaded yet
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aab290>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_79d2857fa4c83335737b39bb1bcd7797.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5888910>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_dec0daefab0ca35f3172c1ce94a5ee20.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5718750>
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_b4c2c6d961ccfcf9d3b4bfd4bd23c95f.jpg saved to cache
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_97c628925e1714d60ab8eb95c389b7a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_3b8d1eead9259bc46a2b650d979519ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg not downloaded yet
2026-04-27 07:55:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3b090578c066b5a844e8c0381002603b.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead588ac50>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_8c6f9c9e0e72afbaca5181666f904651.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bfa50>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_0e230fb44d764097eee70478c3961371.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5935dd0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_a7c5571eb3dbc9c20826fdcd5785e4f5.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_cfe7077722ca3cdb0bed2107da37949e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d9c79e0aa24a7820daca0fdddffddfc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_329ae67c47a4695b2993df798b41a1be.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_11fe3a2cf71544c883bdfc1580a00465.jpg not downloaded yet
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_659750f5c133de38b179d13696668427.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_bfe65e273c4fe2165c0c0e8336798faf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_34a664a1e66a47037d95584f68b78bed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_799c232ad3a4f700dc4f3b113e97d82c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3519a11c4b4b33bf7f80eafbf196f157.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c36d0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_e68296613fa19e0f0a23b5760a7c3427.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581d910>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5555390>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_9b9fd13ff2f0d5d171b1d20aed19f78a.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_e23a5116f460ebbf6626c049ce377a17.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d85ab34b1dc1e43ac5f94d97092c64d6.jpg not downloaded yet
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_170af16696c0ac7e768b9432edcdb8a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg not downloaded yet
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_9c1fa308cc4c833bec86bc010823711a.jpg not downloaded yet
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3d510>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_97c628925e1714d60ab8eb95c389b7a2.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ac5f50>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_3b8d1eead9259bc46a2b650d979519ee.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_83060fc1eaba94c7cde50b5bd1ffd67b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_c0545c0cc254863b5425995515aa38d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57d5f50>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_cfe7077722ca3cdb0bed2107da37949e.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566dcd0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d9c79e0aa24a7820daca0fdddffddfc7.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a49710>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_659750f5c133de38b179d13696668427.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56af8d0>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_bfe65e273c4fe2165c0c0e8336798faf.jpg saved to cache
2026-04-27 07:55:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c2010>
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_34a664a1e66a47037d95584f68b78bed.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63945d0>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_799c232ad3a4f700dc4f3b113e97d82c.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a9cdd74be17dd80d1fef94ceefbf4a63.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_8ef1f419fac0eed02060447e49856a85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_463f2ddcdac88629fe46165b3a1a7469.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg not downloaded yet
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a226d284f99cbb4e5414efa4f63670ee.jpg not downloaded yet
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a6090>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_170af16696c0ac7e768b9432edcdb8a8.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3b090578c066b5a844e8c0381002603b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55bef90>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_83060fc1eaba94c7cde50b5bd1ffd67b.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae592b290>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_c0545c0cc254863b5425995515aa38d2.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c7510>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a9cdd74be17dd80d1fef94ceefbf4a63.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b2510>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_8ef1f419fac0eed02060447e49856a85.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2e350>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571cd50>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_463f2ddcdac88629fe46165b3a1a7469.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65daa50>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_577d23e6f2f5fdf28ba61e1248b7baaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d85ab34b1dc1e43ac5f94d97092c64d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_e23a5116f460ebbf6626c049ce377a17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_858800154ed84bdc0e21e1531a8d8a9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_1d04974c1c7f2f9e59eb5fe4e951da62.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3519a11c4b4b33bf7f80eafbf196f157.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JF91368> (referer: https://www.auto1.com/v1/car-details-view/JF91368/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6447550>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3b090578c066b5a844e8c0381002603b.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577ba10>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_577d23e6f2f5fdf28ba61e1248b7baaa.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a91010>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d85ab34b1dc1e43ac5f94d97092c64d6.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5645dd0>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_e23a5116f460ebbf6626c049ce377a17.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_9c1fa308cc4c833bec86bc010823711a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0d650>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d5850>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d4990>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_858800154ed84bdc0e21e1531a8d8a9b.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead637a8d0>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_1d04974c1c7f2f9e59eb5fe4e951da62.jpg saved to cache
2026-04-27 07:55:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63fb410>
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3519a11c4b4b33bf7f80eafbf196f157.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f45c3104-3ba7-572c-a278-463b0187ba0a with identifier: JF91368
2026-04-27 07:55:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45c3104-3ba7-572c-a278-463b0187ba0a with scrape type 1
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_b206a65ee7d43eeee6441fd925f17287.jpg not downloaded yet
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a226d284f99cbb4e5414efa4f63670ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_329ae67c47a4695b2993df798b41a1be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_fc7df8d47ca1c4f467e41f830643df12.jpg not downloaded yet
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_11fe3a2cf71544c883bdfc1580a00465.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_e67a7542c825bff97019905f81387eb4.jpg not downloaded yet
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5893710>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a49910>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_9c1fa308cc4c833bec86bc010823711a.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65bb210>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1d19b923431fca9f6ade87aa61af73c2.jpg not downloaded yet
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_e3429fbf9361e1ddfdff1a174f4cc10a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_4858306048fa8e11cf85b1bba4931668.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_52afb2d3396cd36ad222cefd7d347516.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_7cc50224d5322904a7f45ea3afa2108b.jpg not downloaded yet
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JV22884> (referer: https://www.auto1.com/v1/car-details-view/JV22884/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_3e59a275a87a9e024cb9bbd755e81da8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_12d21d1b80f723a1b4546ea6e31d315c.jpg not downloaded yet
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ccfd0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f2e90>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c090>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a226d284f99cbb4e5414efa4f63670ee.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f1290>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_329ae67c47a4695b2993df798b41a1be.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5754dd0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f2dd0>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763710>
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_11fe3a2cf71544c883bdfc1580a00465.jpg saved to cache
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1cb46eb576f279bbb706912e762236cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_0da1029aae783d5a6605c0c3207d451b.jpg not downloaded yet
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_b206a65ee7d43eeee6441fd925f17287.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_7f08a4838fe08503d5043773d9236d3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_6c7e9f3b2bfaa8054197196a77775d01.jpg not downloaded yet
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5756850>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_e3429fbf9361e1ddfdff1a174f4cc10a.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ac550>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_4858306048fa8e11cf85b1bba4931668.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7d250>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_52afb2d3396cd36ad222cefd7d347516.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488
2026-04-27 07:55:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4ea8e0f2-0da0-5f43-8fde-57ae37475488, skipping ID generation
2026-04-27 07:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with scrape type 1
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4ea8e0f2-0da0-5f43-8fde-57ae37475488 sending to next pipeline
2026-04-27 07:55:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4ea8e0f2-0da0-5f43-8fde-57ae37475488, identifier: BY24023
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564d590>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae540a110>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg saved to cache
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-04-27 07:55:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39495df-9352-5393-a5d9-0752bbeeafab with scrape type 1
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg not downloaded yet
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5941d90>
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_3e59a275a87a9e024cb9bbd755e81da8.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4b06d10>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57aa550>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_4be29e040ea465155edfc82f59479472.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ec6b46f431392263d1590bb885ce25c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_e67a7542c825bff97019905f81387eb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1d19b923431fca9f6ade87aa61af73c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_7cc50224d5322904a7f45ea3afa2108b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_2a5c8dc379c502b25fac11b1768f168e.jpg not downloaded yet
2026-04-27 07:55:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with identifier: BY24023
2026-04-27 07:55:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with identifier: BY24023
2026-04-27 07:55:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4ea8e0f2-0da0-5f43-8fde-57ae37475488 with identifier: BY24023 to the API
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_52afb2d3396cd36ad222cefd7d347516.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:09:35Z',
'fuel_type': 'petrol',
'id': '4ea8e0f2-0da0-5f43-8fde-57ae37475488',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BY24023',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Audi',
'model': 'Q2',
'odometer': 12170,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_0e230fb44d764097eee70478c3961371.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_34a664a1e66a47037d95584f68b78bed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86852,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_799c232ad3a4f700dc4f3b113e97d82c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_52afb2d3396cd36ad222cefd7d347516.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a9cdd74be17dd80d1fef94ceefbf4a63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_8ef1f419fac0eed02060447e49856a85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75289,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3b090578c066b5a844e8c0381002603b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_3519a11c4b4b33bf7f80eafbf196f157.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_9c1fa308cc4c833bec86bc010823711a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4ea8e0f2-0da0-5f43-8fde-57ae37475488/4ea8e0f2-0da0-5f43-8fde-57ae37475488_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45069,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgcb/4b/cb4b91325b376900a20b6a70c51abc1d/pa/BY24023_a226d284f99cbb4e5414efa4f63670ee.jpg',
'Width': 640}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2023-08-22',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 35 TFSI S line',
'transmission': 'automatic',
'trim': 'S line',
'year': 2023}
2026-04-27 07:55:05 [auto1.it] INFO: Saving data for BY24023: {'created_time': 1777276505.572817, 'last_price_update_time': 1777276505.572829, 'has_photos': True, 'auction_closing_time': 1777388975.0}
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_4d8465240e48a6fafc5c67c4557165d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_fc7df8d47ca1c4f467e41f830643df12.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_dd31e11198bc99641d20982b1601255e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg not downloaded yet
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1418f8a00ea388bdcb1206ae87daec1a.jpg not downloaded yet
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c7650>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1cb46eb576f279bbb706912e762236cc.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64109d0>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_b206a65ee7d43eeee6441fd925f17287.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785150>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_7f08a4838fe08503d5043773d9236d3d.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59251d0>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552c290>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg not downloaded yet
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5963650>
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_4be29e040ea465155edfc82f59479472.jpg saved to cache
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605
2026-04-27 07:55:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8b74a17-2242-5ad5-b66c-34d7cbbcd605, skipping ID generation
2026-04-27 07:55:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with scrape type 1
2026-04-27 07:55:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8b74a17-2242-5ad5-b66c-34d7cbbcd605 sending to next pipeline
2026-04-27 07:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f8b74a17-2242-5ad5-b66c-34d7cbbcd605, identifier: NV63699
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649e6d0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ec6b46f431392263d1590bb885ce25c0.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5786510>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_e67a7542c825bff97019905f81387eb4.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5730710>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1d19b923431fca9f6ade87aa61af73c2.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6395f90>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_7cc50224d5322904a7f45ea3afa2108b.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_c30e061bbe9dd9f7fc43ebdded44d46b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_d6bdf01327366d602664c38a37fe8999.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_12d21d1b80f723a1b4546ea6e31d315c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg not downloaded yet
2026-04-27 07:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with identifier: NV63699
2026-04-27 07:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with identifier: NV63699
2026-04-27 07:55:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f8b74a17-2242-5ad5-b66c-34d7cbbcd605 with identifier: NV63699 to the API
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_4be29e040ea465155edfc82f59479472.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'category': None,
'city': 'Villasanta',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:02:39Z',
'fuel_type': 'petrol',
'id': 'f8b74a17-2242-5ad5-b66c-34d7cbbcd605',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.6063,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV63699',
'listing': 'auction',
'location': 'IT, Villasanta',
'location_confidence': 'geocoded',
'longitude': 9.308,
'make': 'Fiat',
'model': 'Punto',
'odometer': 194485,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_e68296613fa19e0f0a23b5760a7c3427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_4be29e040ea465155edfc82f59479472.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_bfe65e273c4fe2165c0c0e8336798faf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83448,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_170af16696c0ac7e768b9432edcdb8a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_463f2ddcdac88629fe46165b3a1a7469.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f8b74a17-2242-5ad5-b66c-34d7cbbcd605/f8b74a17-2242-5ad5-b66c-34d7cbbcd605_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/9f/b29f146c1e8c048b5a18257a9fc720d0/pa/NV63699_858800154ed84bdc0e21e1531a8d8a9b.jpg',
'Width': 800}],
'postal_code': '20852',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2013-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.2 Easy',
'transmission': 'manual',
'trim': 'Easy',
'year': 2013}
2026-04-27 07:55:06 [auto1.it] INFO: Saving data for NV63699: {'created_time': 1777276506.655859, 'last_price_update_time': 1777276506.655869, 'has_photos': True, 'auction_closing_time': 1777388559.0}
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4dd8b10>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_4d8465240e48a6fafc5c67c4557165d1.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c434968d-4fde-5397-847b-009d36ad1ba4
2026-04-27 07:55:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c434968d-4fde-5397-847b-009d36ad1ba4, skipping ID generation
2026-04-27 07:55:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c434968d-4fde-5397-847b-009d36ad1ba4 with scrape type 1
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c434968d-4fde-5397-847b-009d36ad1ba4 sending to next pipeline
2026-04-27 07:55:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c434968d-4fde-5397-847b-009d36ad1ba4, identifier: HA44632
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560d5d0>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_fc7df8d47ca1c4f467e41f830643df12.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5679610>
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_dd31e11198bc99641d20982b1601255e.jpg saved to cache
2026-04-27 07:55:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:55:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ad7ed84d524ca6d4f066a3fbd5cdbe52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c434968d-4fde-5397-847b-009d36ad1ba4 with identifier: HA44632
2026-04-27 07:55:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c434968d-4fde-5397-847b-009d36ad1ba4 with identifier: HA44632
2026-04-27 07:55:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c434968d-4fde-5397-847b-009d36ad1ba4 with identifier: HA44632 to the API
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_4d8465240e48a6fafc5c67c4557165d1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:49:07Z',
'fuel_type': 'diesel',
'id': 'c434968d-4fde-5397-847b-009d36ad1ba4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA44632',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'BMW',
'model': 'X1',
'odometer': 267112,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78366,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_dec0daefab0ca35f3172c1ce94a5ee20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_8c6f9c9e0e72afbaca5181666f904651.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_3b8d1eead9259bc46a2b650d979519ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_4d8465240e48a6fafc5c67c4557165d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d9c79e0aa24a7820daca0fdddffddfc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_c0545c0cc254863b5425995515aa38d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_e3429fbf9361e1ddfdff1a174f4cc10a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_1d04974c1c7f2f9e59eb5fe4e951da62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_11fe3a2cf71544c883bdfc1580a00465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c434968d-4fde-5397-847b-009d36ad1ba4/c434968d-4fde-5397-847b-009d36ad1ba4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img46/d5/46d5a1ea9acfcb2c709241b7d5d56dc8/pa/HA44632_d85ab34b1dc1e43ac5f94d97092c64d6.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2011-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 xDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-04-27 07:55:07 [auto1.it] INFO: Saving data for HA44632: {'created_time': 1777276507.531753, 'last_price_update_time': 1777276507.53177, 'has_photos': True, 'auction_closing_time': 1777391347.0}
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_b144ca57b23c8190757261332452e8a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg not downloaded yet
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_0da1029aae783d5a6605c0c3207d451b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_f9ec249de74881c982e4cb6df13aaac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_f843ff628dfb2c7422da193480601576.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_6c7e9f3b2bfaa8054197196a77775d01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_d2e713d681e71b19bb83136572c12bb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg not downloaded yet
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c4690>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_c30e061bbe9dd9f7fc43ebdded44d46b.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ccdd0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_d6bdf01327366d602664c38a37fe8999.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead573b290>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ae3d0>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_12d21d1b80f723a1b4546ea6e31d315c.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c1110>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg saved to cache
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c7d812d-506f-5f49-bd27-064e7059e4b7
2026-04-27 07:55:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c7d812d-506f-5f49-bd27-064e7059e4b7, skipping ID generation
2026-04-27 07:55:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c7d812d-506f-5f49-bd27-064e7059e4b7 with scrape type 1
2026-04-27 07:55:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c7d812d-506f-5f49-bd27-064e7059e4b7 sending to next pipeline
2026-04-27 07:55:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c7d812d-506f-5f49-bd27-064e7059e4b7, identifier: VA85498
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c2d50>
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ad7ed84d524ca6d4f066a3fbd5cdbe52.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc34d080-3e8c-55d3-b033-744a832eb719
2026-04-27 07:55:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc34d080-3e8c-55d3-b033-744a832eb719, skipping ID generation
2026-04-27 07:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc34d080-3e8c-55d3-b033-744a832eb719 with scrape type 1
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc34d080-3e8c-55d3-b033-744a832eb719 sending to next pipeline
2026-04-27 07:55:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc34d080-3e8c-55d3-b033-744a832eb719, identifier: EX64353
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c7d812d-506f-5f49-bd27-064e7059e4b7 with identifier: VA85498 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:45:09Z',
'fuel_type': 'diesel',
'id': '2c7d812d-506f-5f49-bd27-064e7059e4b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA85498',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 143796,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_fe99937b6f2126f34afe8dd9617cd229.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_149ecf49db928bac89c0bf805a8c7da9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_a8a2bb737bfe5dbaad2bd671d649db89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7a25526496be447d6252b38718365796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_0a4262e6e046d71b5d6cf85e28d8a953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_5d10d25a5e2926cafaa691ed86e1ecf8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98633,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_7bbb74cddc3cae73ea5455b18cf25041.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_082f915adf968a80fb96dc00f1a870c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_e733dd5b60bed16c6a4bd16738811e64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c7d812d-506f-5f49-bd27-064e7059e4b7/2c7d812d-506f-5f49-bd27-064e7059e4b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/5f/965f0ca0d49043f664dc6a188f87c393/pa/VA85498_c45b623f6a2b5fe3a8a2413e93fcb0a5.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2013-07-07',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 1.6 JTDM Progression',
'transmission': 'manual',
'trim': 'Progression',
'year': 2013}
2026-04-27 07:55:08 [auto1.it] INFO: Saving data for VA85498: {'created_time': 1777276508.494412, 'last_price_update_time': 1777276508.494427, 'has_photos': True, 'auction_closing_time': 1777391109.0}
2026-04-27 07:55:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc34d080-3e8c-55d3-b033-744a832eb719 with identifier: EX64353
2026-04-27 07:55:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc34d080-3e8c-55d3-b033-744a832eb719 with identifier: EX64353
2026-04-27 07:55:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc34d080-3e8c-55d3-b033-744a832eb719 with identifier: EX64353 to the API
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ad7ed84d524ca6d4f066a3fbd5cdbe52.jpg>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'city': 'Padova',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:11:36Z',
'fuel_type': 'diesel',
'id': 'fc34d080-3e8c-55d3-b033-744a832eb719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX64353',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'MINI',
'model': 'Countryman',
'odometer': 154598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_79d2857fa4c83335737b39bb1bcd7797.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ad7ed84d524ca6d4f066a3fbd5cdbe52.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_9b9fd13ff2f0d5d171b1d20aed19f78a.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_ec6b46f431392263d1590bb885ce25c0.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_659750f5c133de38b179d13696668427.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_83060fc1eaba94c7cde50b5bd1ffd67b.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 31670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_4858306048fa8e11cf85b1bba4931668.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_577d23e6f2f5fdf28ba61e1248b7baaa.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_329ae67c47a4695b2993df798b41a1be.jpg',
'Width': 452},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc34d080-3e8c-55d3-b033-744a832eb719/fc34d080-3e8c-55d3-b033-744a832eb719_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img12/f9/12f9e8447eb329f3c3608b649cfc20bf/pa/EX64353_e23a5116f460ebbf6626c049ce377a17.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2014-01-23',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper SD ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2014}
2026-04-27 07:55:08 [auto1.it] INFO: Saving data for EX64353: {'created_time': 1777276508.880171, 'last_price_update_time': 1777276508.880183, 'has_photos': True, 'auction_closing_time': 1777389096.0}
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1418f8a00ea388bdcb1206ae87daec1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg not downloaded yet
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_245085c69b4671e9a6e155e89936fa35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ee7530938237abadad0140005b19d4ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_2a5c8dc379c502b25fac11b1768f168e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_699896486368a3f9e685e27bf5d2a2d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dba50>
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg saved to cache
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad5eee9e-aeff-5065-b05b-6092eb81aa21
2026-04-27 07:55:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad5eee9e-aeff-5065-b05b-6092eb81aa21, skipping ID generation
2026-04-27 07:55:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad5eee9e-aeff-5065-b05b-6092eb81aa21 with scrape type 1
2026-04-27 07:55:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad5eee9e-aeff-5065-b05b-6092eb81aa21 sending to next pipeline
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad5eee9e-aeff-5065-b05b-6092eb81aa21, identifier: BF48403
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c7d10>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_b144ca57b23c8190757261332452e8a1.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b9910>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_0da1029aae783d5a6605c0c3207d451b.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0350>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_f9ec249de74881c982e4cb6df13aaac7.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20349491-f6fd-5c0e-80b6-d3150bedf530
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20349491-f6fd-5c0e-80b6-d3150bedf530, skipping ID generation
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20349491-f6fd-5c0e-80b6-d3150bedf530 with scrape type 1
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20349491-f6fd-5c0e-80b6-d3150bedf530 sending to next pipeline
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 20349491-f6fd-5c0e-80b6-d3150bedf530, identifier: AG12486
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5517a90>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_f843ff628dfb2c7422da193480601576.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5756210>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_6c7e9f3b2bfaa8054197196a77775d01.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f3950>
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_d2e713d681e71b19bb83136572c12bb1.jpg saved to cache
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d96e79f-a6ca-5672-bb00-1243bc449b09
2026-04-27 07:55:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d96e79f-a6ca-5672-bb00-1243bc449b09, skipping ID generation
2026-04-27 07:55:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d96e79f-a6ca-5672-bb00-1243bc449b09 with scrape type 1
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d96e79f-a6ca-5672-bb00-1243bc449b09 sending to next pipeline
2026-04-27 07:55:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d96e79f-a6ca-5672-bb00-1243bc449b09, identifier: RY16068
2026-04-27 07:55:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg not downloaded yet
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403
2026-04-27 07:55:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad5eee9e-aeff-5065-b05b-6092eb81aa21 with identifier: BF48403 to the API
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Manoppello',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:00:50Z',
'fuel_type': 'diesel',
'id': 'ad5eee9e-aeff-5065-b05b-6092eb81aa21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 42.2592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF48403',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'location_confidence': 'geocoded',
'longitude': 14.0602,
'make': 'Audi',
'model': 'A4',
'odometer': 164288,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_aa89d52a74e3821e63881e8477c03b26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_07fc159a39546097e211bbed0e19adb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4c4e4abe07e6316b5c5ab9e729a28ec5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_f9351e7c7e886bbbc181f6bacba4582d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9a4fe3c2762d3a145c65bbd85bbbb86d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_74f23e28fd483e414b72b39c1240e9b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_4a091b5c61eb895c71c15f9748c44d82.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_9710d8ccb76aa516d258641e844ebd48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_22b3b5db4fe3861a03207101a262f4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad5eee9e-aeff-5065-b05b-6092eb81aa21/ad5eee9e-aeff-5065-b05b-6092eb81aa21_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/ce/93ce8bc5a1f3285a98ed704d338abebe/pa/BF48403_79ace9b4cff4383687807a70b93d91a3.jpg',
'Width': 800}],
'postal_code': '65024',
'price': 0,
'price_includes_vat': True,
'province': 'Pescara',
'province_code': 'IT-PE',
'region': 'Abruzzi',
'region_code': 'IT-01',
'registration_date': '2019-02-18',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 40 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2019}
2026-04-27 07:55:09 [auto1.it] INFO: Saving data for BF48403: {'created_time': 1777276509.95447, 'last_price_update_time': 1777276509.954574, 'has_photos': True, 'auction_closing_time': 1777388450.0}
2026-04-27 07:55:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 20349491-f6fd-5c0e-80b6-d3150bedf530 with identifier: AG12486
2026-04-27 07:55:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 20349491-f6fd-5c0e-80b6-d3150bedf530 with identifier: AG12486
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 20349491-f6fd-5c0e-80b6-d3150bedf530 with identifier: AG12486 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_f9ec249de74881c982e4cb6df13aaac7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'city': 'Varedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 122,
'expiration_date': '2026-04-28T15:51:56Z',
'fuel_type': 'petrol',
'id': '20349491-f6fd-5c0e-80b6-d3150bedf530',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG12486',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 157007,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_5aaa0c8512661e6899267ea1314c12e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57616,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_ae06478a05371b1a0bca8b1d7131f75a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6185b2cc2a50726acee2faebabbfa0a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_6c94ad6db3ea83ecdc3a6c4a9d29c1b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_8a35973970698c13136f844d6fb6e3c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_b4c2c6d961ccfcf9d3b4bfd4bd23c95f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_f9ec249de74881c982e4cb6df13aaac7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_cfe7077722ca3cdb0bed2107da37949e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_d6bdf01327366d602664c38a37fe8999.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_20349491-f6fd-5c0e-80b6-d3150bedf530/20349491-f6fd-5c0e-80b6-d3150bedf530_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69804,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb2/7f/b27fabb1c3b7c46d61a1d8651d352592/pa/AG12486_7f08a4838fe08503d5043773d9236d3d.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2012-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.4 TSI Trend & Fun BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trend & Fun BlueMotion Tech',
'year': 2012}
2026-04-27 07:55:10 [auto1.it] INFO: Saving data for AG12486: {'created_time': 1777276510.377126, 'last_price_update_time': 1777276510.377139, 'has_photos': True, 'auction_closing_time': 1777391516.0}
2026-04-27 07:55:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d96e79f-a6ca-5672-bb00-1243bc449b09 with identifier: RY16068
2026-04-27 07:55:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d96e79f-a6ca-5672-bb00-1243bc449b09 with identifier: RY16068
2026-04-27 07:55:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d96e79f-a6ca-5672-bb00-1243bc449b09 with identifier: RY16068 to the API
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_d2e713d681e71b19bb83136572c12bb1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Roma',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 107,
'expiration_date': '2026-04-28T15:40:48Z',
'fuel_type': 'diesel',
'id': '1d96e79f-a6ca-5672-bb00-1243bc449b09',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RY16068',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Dacia',
'model': 'Duster',
'odometer': 95030,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_f5c51cdc7a3e143d1f48e9f084fe0b5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96655,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_507310c8665089cd3733be5f7f3ef7ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4d83848a472477fee2d0f45a09099850.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_4cf2053328a7c79895aa1cc26f98bf77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_7168ebe6a82c881e68aca6d84cd29059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_a7c5571eb3dbc9c20826fdcd5785e4f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_d2e713d681e71b19bb83136572c12bb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_97c628925e1714d60ab8eb95c389b7a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_dd31e11198bc99641d20982b1601255e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d96e79f-a6ca-5672-bb00-1243bc449b09/1d96e79f-a6ca-5672-bb00-1243bc449b09_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/dd/89dd68bbab9dad7ebaa0490a51593e22/pa/RY16068_3e59a275a87a9e024cb9bbd755e81da8.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2012-01-11',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 dCi Laureate 4x2',
'transmission': 'manual',
'trim': 'Laureate 4x2',
'year': 2012}
2026-04-27 07:55:10 [auto1.it] INFO: Saving data for RY16068: {'created_time': 1777276510.728774, 'last_price_update_time': 1777276510.728783, 'has_photos': True, 'auction_closing_time': 1777390848.0}
2026-04-27 07:55:10 [scrapy.extensions.logstats] INFO: Crawled 89 pages (at 89 pages/min), scraped 27 items (at 27 items/min)
2026-04-27 07:55:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 374MiB
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_a4509a64f2e6bbe3090e2f20df9e2712.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_22a18185f03e16bfaded19355e519010.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_3b6dcf28bd4fbb648e17b027cb385221.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_6fe28407158ff597c70b96db3551e32a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg not downloaded yet
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d9e50>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1418f8a00ea388bdcb1206ae87daec1a.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659a050>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64bbf50>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead574e9d0>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_245085c69b4671e9a6e155e89936fa35.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57d5850>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ee7530938237abadad0140005b19d4ba.jpg saved to cache
2026-04-27 07:55:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6379790>
2026-04-27 07:55:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d5910>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_2a5c8dc379c502b25fac11b1768f168e.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f45c3104-3ba7-572c-a278-463b0187ba0a
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f45c3104-3ba7-572c-a278-463b0187ba0a, skipping ID generation
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45c3104-3ba7-572c-a278-463b0187ba0a with scrape type 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f45c3104-3ba7-572c-a278-463b0187ba0a sending to next pipeline
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f45c3104-3ba7-572c-a278-463b0187ba0a, identifier: JF91368
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4ef59d0>
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_699896486368a3f9e685e27bf5d2a2d1.jpg saved to cache
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3d19105-8447-595c-bb85-063eaeee7c8a
2026-04-27 07:55:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3d19105-8447-595c-bb85-063eaeee7c8a, skipping ID generation
2026-04-27 07:55:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3d19105-8447-595c-bb85-063eaeee7c8a with scrape type 1
2026-04-27 07:55:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3d19105-8447-595c-bb85-063eaeee7c8a sending to next pipeline
2026-04-27 07:55:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3d19105-8447-595c-bb85-063eaeee7c8a, identifier: FA49150
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_ccd9aa3a74934638cdb66bf0c6b564a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_a43c33cc1a7ffa2dd4ec898f76a81e6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f45c3104-3ba7-572c-a278-463b0187ba0a with identifier: JF91368
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f45c3104-3ba7-572c-a278-463b0187ba0a with identifier: JF91368
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f45c3104-3ba7-572c-a278-463b0187ba0a with identifier: JF91368 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_2a5c8dc379c502b25fac11b1768f168e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:53:54Z',
'fuel_type': 'petrol',
'id': 'f45c3104-3ba7-572c-a278-463b0187ba0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF91368',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 69448,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_b206a65ee7d43eeee6441fd925f17287.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_fc7df8d47ca1c4f467e41f830643df12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_e67a7542c825bff97019905f81387eb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1d19b923431fca9f6ade87aa61af73c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_7cc50224d5322904a7f45ea3afa2108b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_12d21d1b80f723a1b4546ea6e31d315c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_0da1029aae783d5a6605c0c3207d451b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_6c7e9f3b2bfaa8054197196a77775d01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_2a5c8dc379c502b25fac11b1768f168e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45c3104-3ba7-572c-a278-463b0187ba0a/f45c3104-3ba7-572c-a278-463b0187ba0a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3f/b4/3fb4510f9e0a76c502da7bf9cd6b5d02/pa/JF91368_1418f8a00ea388bdcb1206ae87daec1a.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 Elefantino II',
'transmission': 'manual',
'trim': 'Elefantino II',
'year': 2014}
2026-04-27 07:55:11 [auto1.it] INFO: Saving data for JF91368: {'created_time': 1777276511.655785, 'last_price_update_time': 1777276511.655797, 'has_photos': True, 'auction_closing_time': 1777391634.0}
2026-04-27 07:55:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3d19105-8447-595c-bb85-063eaeee7c8a with identifier: FA49150
2026-04-27 07:55:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3d19105-8447-595c-bb85-063eaeee7c8a with identifier: FA49150
2026-04-27 07:55:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3d19105-8447-595c-bb85-063eaeee7c8a with identifier: FA49150 to the API
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_699896486368a3f9e685e27bf5d2a2d1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'city': 'Varedo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:59:56Z',
'fuel_type': 'diesel',
'id': 'd3d19105-8447-595c-bb85-063eaeee7c8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA49150',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 229619,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71902,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_187c867eede08c1669a89a2a5f76f14f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_0ddbb8065e7c29931c22d2236ba8b953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_fe41ef93844e69fa75631ed304bad5de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52031,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1c5abf0210268c9b988437e0cba4778d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_ea4587949c269c9ae4664c499bf8d98b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_699896486368a3f9e685e27bf5d2a2d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_f843ff628dfb2c7422da193480601576.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_b144ca57b23c8190757261332452e8a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_c30e061bbe9dd9f7fc43ebdded44d46b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3d19105-8447-595c-bb85-063eaeee7c8a/d3d19105-8447-595c-bb85-063eaeee7c8a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/59/085994201dcd05adc9d3ac51cca143bd/pa/FA49150_1cb46eb576f279bbb706912e762236cc.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2016}
2026-04-27 07:55:12 [auto1.it] INFO: Saving data for FA49150: {'created_time': 1777276512.125595, 'last_price_update_time': 1777276512.12561, 'has_photos': True, 'auction_closing_time': 1777391996.0}
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg not downloaded yet
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_03daae2549c9ccc14af1a0e009940376.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_5035b69d3daccc357244ba08a640e3ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_6ef412829ef6b557ba463d2d3b3d8d50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_b5bca36ebb89388f9417cc697591e56f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_f54985eab169fed6c78336de9116abef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5821d10>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_a4509a64f2e6bbe3090e2f20df9e2712.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e09d0>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_22a18185f03e16bfaded19355e519010.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5529990>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7f3d0>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5528a90>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_3b6dcf28bd4fbb648e17b027cb385221.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552b410>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_6fe28407158ff597c70b96db3551e32a.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56984d0>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_ccd9aa3a74934638cdb66bf0c6b564a2.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a88310>
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_a43c33cc1a7ffa2dd4ec898f76a81e6e.jpg saved to cache
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c30b230-d398-518b-b458-c74d644d5567
2026-04-27 07:55:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c30b230-d398-518b-b458-c74d644d5567, skipping ID generation
2026-04-27 07:55:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c30b230-d398-518b-b458-c74d644d5567 with scrape type 1
2026-04-27 07:55:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c30b230-d398-518b-b458-c74d644d5567 sending to next pipeline
2026-04-27 07:55:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c30b230-d398-518b-b458-c74d644d5567, identifier: ZG15955
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_614ae3f82c0f7aa63f58bb2314b705ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_0d11081ffbd9d8d1733f0f0b21e51f0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_708cef39ce47a26ac885fc6f3ce2ca3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_5c808d69bea2b6f1fa79c87de38386a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c30b230-d398-518b-b458-c74d644d5567 with identifier: ZG15955
2026-04-27 07:55:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c30b230-d398-518b-b458-c74d644d5567 with identifier: ZG15955
2026-04-27 07:55:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c30b230-d398-518b-b458-c74d644d5567 with identifier: ZG15955 to the API
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_a43c33cc1a7ffa2dd4ec898f76a81e6e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'city': 'Senago',
'color': 'silver',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:39:05Z',
'fuel_type': 'diesel',
'id': '4c30b230-d398-518b-b458-c74d644d5567',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG15955',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'BMW',
'model': '4er',
'odometer': 103440,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_a43c33cc1a7ffa2dd4ec898f76a81e6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_22a18185f03e16bfaded19355e519010.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ee7530938237abadad0140005b19d4ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_245085c69b4671e9a6e155e89936fa35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_b5269b802482303cfeb0291b5bb7a73e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_92a86ddd2c34b8dbe831451d3cb585ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_ec18e3a8eb47b5a88fd527b0d4ff21b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_225420551947b5874083e883665148b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_cac5b6c18921870795f2359b89bf82e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c30b230-d398-518b-b458-c74d644d5567/4c30b230-d398-518b-b458-c74d644d5567_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/88/20883182c51c9a0950269ff3b99559b6/pa/ZG15955_f2b29545ecdbae7e7f1acb2332d20994.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-06-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 4er 430d Gran Coupé xDrive Luxury Line',
'transmission': 'automatic',
'trim': 'xDrive Luxury Line',
'year': 2016}
2026-04-27 07:55:13 [auto1.it] INFO: Saving data for ZG15955: {'created_time': 1777276513.502596, 'last_price_update_time': 1777276513.50261, 'has_photos': True, 'auction_closing_time': 1777390745.0}
2026-04-27 07:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_734048be184e3bdaa851d9ca9335a8b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_cbff662f0f593b863bf8a676f0c9c7c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5885390>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_03daae2549c9ccc14af1a0e009940376.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59e80d0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_5035b69d3daccc357244ba08a640e3ac.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5889650>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c63d0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_6ef412829ef6b557ba463d2d3b3d8d50.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b0490>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_b5bca36ebb89388f9417cc697591e56f.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cb1d0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_f54985eab169fed6c78336de9116abef.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d287ebb1ac1204fc24584087037c3b0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d49fac0297774ea10fb5086f7f4943a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_ee8538c8bf21d983886a3c1ec4a2dec4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_e0c305ce514cd7e3567b0f08c1c79af3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6368dd0>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_614ae3f82c0f7aa63f58bb2314b705ae.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fd110>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_0d11081ffbd9d8d1733f0f0b21e51f0b.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5962610>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg saved to cache
2026-04-27 07:55:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5557890>
2026-04-27 07:55:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55bdb10>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_708cef39ce47a26ac885fc6f3ce2ca3b.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c08d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_5c808d69bea2b6f1fa79c87de38386a5.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_af94d47cbe848d19a6a0c0293b82a205.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a89d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_734048be184e3bdaa851d9ca9335a8b6.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dad90>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_cbff662f0f593b863bf8a676f0c9c7c4.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_7ff4e88112d4185665f09e4b6aaa1be6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_2c5c2708fcd384f6946d81926fcf1d37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0d450>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d287ebb1ac1204fc24584087037c3b0b.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64089d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d49fac0297774ea10fb5086f7f4943a0.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c91d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63959d0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e39495df-9352-5393-a5d9-0752bbeeafab
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e39495df-9352-5393-a5d9-0752bbeeafab, skipping ID generation
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e39495df-9352-5393-a5d9-0752bbeeafab with scrape type 1
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e39495df-9352-5393-a5d9-0752bbeeafab sending to next pipeline
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e39495df-9352-5393-a5d9-0752bbeeafab, identifier: JV22884
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0dd10>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_ee8538c8bf21d983886a3c1ec4a2dec4.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a
2026-04-27 07:55:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a, skipping ID generation
2026-04-27 07:55:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with scrape type 1
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a sending to next pipeline
2026-04-27 07:55:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a, identifier: YV65594
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b5ed0>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_e0c305ce514cd7e3567b0f08c1c79af3.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560c990>
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_af94d47cbe848d19a6a0c0293b82a205.jpg saved to cache
2026-04-27 07:55:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_e46f62d25fa876662a2071fd493b5cec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-04-27 07:55:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e39495df-9352-5393-a5d9-0752bbeeafab with identifier: JV22884 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Senago',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:30:24Z',
'fuel_type': 'diesel',
'id': 'e39495df-9352-5393-a5d9-0752bbeeafab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JV22884',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Fiat',
'model': '500L',
'odometer': 99900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65798,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_5e3a421a2606567b52ae705235b05452.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_3e9a948ff71edfa3540b7c9aecd09932.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_e52febbf4d365fc45f9168fcb7e2e708.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b49c9d4c50bb74bd605d1d82bf419f83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a2bc62e4676e826a1db67eebb30a8129.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_45c7f4975dc0cfadd35b75f907b8aaff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_67c1deff2f544507c2a1e1e3ccdc2001.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_61371bdec99a54d5af652cf7d03a570a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_b387641376517c73b70a96867dfdf55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e39495df-9352-5393-a5d9-0752bbeeafab/e39495df-9352-5393-a5d9-0752bbeeafab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/72/5e72535ff4b47b92ff6651048be9a273/pa/JV22884_a811619db39104463157ba525984a1bf.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2014-07-22',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 JTD Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2014}
2026-04-27 07:55:15 [auto1.it] INFO: Saving data for JV22884: {'created_time': 1777276515.250489, 'last_price_update_time': 1777276515.2505, 'has_photos': True, 'auction_closing_time': 1777390224.0}
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-04-27 07:55:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594
2026-04-27 07:55:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a with identifier: YV65594 to the API
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_ee8538c8bf21d983886a3c1ec4a2dec4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 210,
'category': None,
'city': 'Milano',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 3',
'engine': '2.0L',
'engine_horse_power': 107,
'expiration_date': '2026-04-28T15:22:10Z',
'fuel_type': 'diesel',
'id': '3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV65594',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Lancia',
'model': 'Phedra',
'odometer': 155044,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_ee8538c8bf21d983886a3c1ec4a2dec4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_734048be184e3bdaa851d9ca9335a8b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_0d11081ffbd9d8d1733f0f0b21e51f0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_5035b69d3daccc357244ba08a640e3ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a/3b4e7f13-e2ff-5be6-95cb-6b2f652b1a6a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/2c/622ccef7aed2959a7d21583ca6c8025d/pa/YV65594_a4509a64f2e6bbe3090e2f20df9e2712.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2004-06-24',
'seats_number': 7,
'seller_name': None,
'title': 'Lancia Phedra 2.0 JTD Emblema Comfortronic',
'transmission': 'automatic',
'trim': 'Emblema Comfortronic',
'year': 2004}
2026-04-27 07:55:15 [auto1.it] INFO: Saving data for YV65594: {'created_time': 1777276515.733675, 'last_price_update_time': 1777276515.733688, 'has_photos': True, 'auction_closing_time': 1777389730.0}
2026-04-27 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_809b6b0342973034744dd7636accf17d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RR38006> (referer: https://www.auto1.com/v1/car-details-view/RR38006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead592e8d0>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_7ff4e88112d4185665f09e4b6aaa1be6.jpg saved to cache
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05993fb1-fb59-5b60-b183-766514bc4158
2026-04-27 07:55:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05993fb1-fb59-5b60-b183-766514bc4158, skipping ID generation
2026-04-27 07:55:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05993fb1-fb59-5b60-b183-766514bc4158 with scrape type 1
2026-04-27 07:55:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05993fb1-fb59-5b60-b183-766514bc4158 sending to next pipeline
2026-04-27 07:55:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 05993fb1-fb59-5b60-b183-766514bc4158, identifier: DL48698
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580c950>
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_2c5c2708fcd384f6946d81926fcf1d37.jpg saved to cache
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead592e250>
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_e46f62d25fa876662a2071fd493b5cec.jpg saved to cache
2026-04-27 07:55:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 05993fb1-fb59-5b60-b183-766514bc4158 with identifier: DL48698
2026-04-27 07:55:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 05993fb1-fb59-5b60-b183-766514bc4158 with identifier: DL48698
2026-04-27 07:55:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 05993fb1-fb59-5b60-b183-766514bc4158 with identifier: DL48698 to the API
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_7ff4e88112d4185665f09e4b6aaa1be6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 267,
'category': None,
'city': 'Roma',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.5L',
'engine_horse_power': 175,
'expiration_date': '2026-04-28T15:09:58Z',
'fuel_type': 'diesel',
'id': '05993fb1-fb59-5b60-b183-766514bc4158',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DL48698',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 134717,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_7ff4e88112d4185665f09e4b6aaa1be6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_e0c305ce514cd7e3567b0f08c1c79af3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_af94d47cbe848d19a6a0c0293b82a205.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_708cef39ce47a26ac885fc6f3ce2ca3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_614ae3f82c0f7aa63f58bb2314b705ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84561,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_f54985eab169fed6c78336de9116abef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_03daae2549c9ccc14af1a0e009940376.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_b2e80196947d6ed90b2f510d893537f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83314,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_ccd9aa3a74934638cdb66bf0c6b564a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_05993fb1-fb59-5b60-b183-766514bc4158/05993fb1-fb59-5b60-b183-766514bc4158_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/82/6f828d34a9679b09a43ad151a33bfc33/pa/DL48698_6fe28407158ff597c70b96db3551e32a.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2008-07-23',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touareg 2.5 TDI R5 Style',
'transmission': 'manual',
'trim': 'R5 Style',
'year': 2008}
2026-04-27 07:55:17 [auto1.it] INFO: Saving data for DL48698: {'created_time': 1777276517.004649, 'last_price_update_time': 1777276517.004664, 'has_photos': True, 'auction_closing_time': 1777388998.0}
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AJ06383/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ29164/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SP11611/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XM57641/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MV31191/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ72377> (referer: https://www.auto1.com/v1/car-details-view/LZ72377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5731350>
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_809b6b0342973034744dd7636accf17d.jpg saved to cache
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecbe5202-cf70-5829-bea0-948bd2577c9c
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecbe5202-cf70-5829-bea0-948bd2577c9c, skipping ID generation
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecbe5202-cf70-5829-bea0-948bd2577c9c with scrape type 1
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecbe5202-cf70-5829-bea0-948bd2577c9c sending to next pipeline
2026-04-27 07:55:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ecbe5202-cf70-5829-bea0-948bd2577c9c, identifier: BR92106
2026-04-27 07:55:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 047a4dc4-e818-516c-8ab2-d50e1ed7c859 with identifier: RR38006
2026-04-27 07:55:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 047a4dc4-e818-516c-8ab2-d50e1ed7c859 with scrape type 1
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 047a4dc4-e818-516c-8ab2-d50e1ed7c859
2026-04-27 07:55:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_37c50eed31fa58cdd35bfb9bf6269e1b.jpg not downloaded yet
2026-04-27 07:55:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ecbe5202-cf70-5829-bea0-948bd2577c9c with identifier: BR92106
2026-04-27 07:55:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ecbe5202-cf70-5829-bea0-948bd2577c9c with identifier: BR92106
2026-04-27 07:55:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ecbe5202-cf70-5829-bea0-948bd2577c9c with identifier: BR92106 to the API
2026-04-27 07:55:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_809b6b0342973034744dd7636accf17d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': 'Rental',
'city': 'Milazzo',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:06:24Z',
'fuel_type': 'diesel',
'id': 'ecbe5202-cf70-5829-bea0-948bd2577c9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR92106',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Fiat',
'model': '500L',
'odometer': 92053,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_2c5c2708fcd384f6946d81926fcf1d37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_e46f62d25fa876662a2071fd493b5cec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64011,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_809b6b0342973034744dd7636accf17d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56889,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d287ebb1ac1204fc24584087037c3b0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56752,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_d49fac0297774ea10fb5086f7f4943a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_cbff662f0f593b863bf8a676f0c9c7c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_5c808d69bea2b6f1fa79c87de38386a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_6ef412829ef6b557ba463d2d3b3d8d50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_b5bca36ebb89388f9417cc697591e56f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ecbe5202-cf70-5829-bea0-948bd2577c9c/ecbe5202-cf70-5829-bea0-948bd2577c9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7c/4b/7c4b03da888d9854023b1226ad155761/pa/BR92106_3b6dcf28bd4fbb648e17b027cb385221.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2014-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 JTD Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2014}
2026-04-27 07:55:18 [auto1.it] INFO: Saving data for BR92106: {'created_time': 1777276518.54252, 'last_price_update_time': 1777276518.542539, 'has_photos': True, 'auction_closing_time': 1777388784.0}
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_4da0bdbc642f979653c614757288bdcc.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_eb3a7b0a28bc86a288c0faea3cec8124.jpg not downloaded yet
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM11859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aacde8b8-db6f-5061-8754-b4d7e6a62279 with identifier: LZ72377
2026-04-27 07:55:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aacde8b8-db6f-5061-8754-b4d7e6a62279 with scrape type 1
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_bfa30fa73461cca9d9ebe4fa09e2d316.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_f423eff5fba2a99aa12e56690c5b68e1.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_fd34e03e4dff7ba99482a8c86bd834d5.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_c7c3933699d20c174570b6e801cf9e9b.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a54a1ec25ded4d863631a83ad01c6a99.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_9a3804cd260ef7b37d86f87a2ae8af67.jpg not downloaded yet
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_4da0bdbc642f979653c614757288bdcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3c196f097abc140c73d5d2838a8ed30c.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3a4c3d230d33e9b4420569eb0a708d0e.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_02002786344195f24c152e83f9ac9d3d.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_157011dbb86c4c327739d90efd6b6ad5.jpg not downloaded yet
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_9a3804cd260ef7b37d86f87a2ae8af67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_062acb42b0a732b35ca68e02c47b3789.jpg not downloaded yet
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a57e78ff753f5e61e656654a31eceab2.jpg not downloaded yet
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5969250>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_047a4dc4-e818-516c-8ab2-d50e1ed7c859/047a4dc4-e818-516c-8ab2-d50e1ed7c859_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_4da0bdbc642f979653c614757288bdcc.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 047a4dc4-e818-516c-8ab2-d50e1ed7c859
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_157011dbb86c4c327739d90efd6b6ad5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f2410>
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_9a3804cd260ef7b37d86f87a2ae8af67.jpg saved to cache
2026-04-27 07:55:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a57e78ff753f5e61e656654a31eceab2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN52810/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953cd0>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_157011dbb86c4c327739d90efd6b6ad5.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_02002786344195f24c152e83f9ac9d3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58db910>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a57e78ff753f5e61e656654a31eceab2.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_062acb42b0a732b35ca68e02c47b3789.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55506d0>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_02002786344195f24c152e83f9ac9d3d.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59686d0>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_062acb42b0a732b35ca68e02c47b3789.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA32540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3a4c3d230d33e9b4420569eb0a708d0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3c196f097abc140c73d5d2838a8ed30c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC87069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a54a1ec25ded4d863631a83ad01c6a99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CW43001/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF81124/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD09696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL44152/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5553290>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3a4c3d230d33e9b4420569eb0a708d0e.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815ad0>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3c196f097abc140c73d5d2838a8ed30c.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cae10>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a54a1ec25ded4d863631a83ad01c6a99.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_fd34e03e4dff7ba99482a8c86bd834d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_bfa30fa73461cca9d9ebe4fa09e2d316.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_c7c3933699d20c174570b6e801cf9e9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_f423eff5fba2a99aa12e56690c5b68e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d4790>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_fd34e03e4dff7ba99482a8c86bd834d5.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b6e90>
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_bfa30fa73461cca9d9ebe4fa09e2d316.jpg saved to cache
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aacde8b8-db6f-5061-8754-b4d7e6a62279
2026-04-27 07:55:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aacde8b8-db6f-5061-8754-b4d7e6a62279, skipping ID generation
2026-04-27 07:55:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aacde8b8-db6f-5061-8754-b4d7e6a62279 with scrape type 1
2026-04-27 07:55:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aacde8b8-db6f-5061-8754-b4d7e6a62279 sending to next pipeline
2026-04-27 07:55:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aacde8b8-db6f-5061-8754-b4d7e6a62279, identifier: LZ72377
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aacde8b8-db6f-5061-8754-b4d7e6a62279 with identifier: LZ72377
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-04-27 07:55:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aacde8b8-db6f-5061-8754-b4d7e6a62279 with identifier: LZ72377
2026-04-27 07:55:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aacde8b8-db6f-5061-8754-b4d7e6a62279 with identifier: LZ72377 to the API
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_bfa30fa73461cca9d9ebe4fa09e2d316.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Capua',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-04-28T15:04:18Z',
'fuel_type': 'petrol',
'id': 'aacde8b8-db6f-5061-8754-b4d7e6a62279',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ72377',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 24349,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68286,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_bfa30fa73461cca9d9ebe4fa09e2d316.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_fd34e03e4dff7ba99482a8c86bd834d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a54a1ec25ded4d863631a83ad01c6a99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_9a3804cd260ef7b37d86f87a2ae8af67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3c196f097abc140c73d5d2838a8ed30c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_3a4c3d230d33e9b4420569eb0a708d0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_02002786344195f24c152e83f9ac9d3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_157011dbb86c4c327739d90efd6b6ad5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_062acb42b0a732b35ca68e02c47b3789.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aacde8b8-db6f-5061-8754-b4d7e6a62279/aacde8b8-db6f-5061-8754-b4d7e6a62279_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69382,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgef/b7/efb74bebb7e1ac949480c1ee9bcbcd06/pa/LZ72377_a57e78ff753f5e61e656654a31eceab2.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2023-06-25',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2023}
2026-04-27 07:55:20 [auto1.it] INFO: Saving data for LZ72377: {'created_time': 1777276520.609567, 'last_price_update_time': 1777276520.609577, 'has_photos': True, 'auction_closing_time': 1777388658.0}
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JJ51062/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YA50042/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK70633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5663b50>
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_047a4dc4-e818-516c-8ab2-d50e1ed7c859/047a4dc4-e818-516c-8ab2-d50e1ed7c859_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_c7c3933699d20c174570b6e801cf9e9b.jpg saved to cache
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 047a4dc4-e818-516c-8ab2-d50e1ed7c859
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58bb4d0>
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_047a4dc4-e818-516c-8ab2-d50e1ed7c859/047a4dc4-e818-516c-8ab2-d50e1ed7c859_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0e/3d/0e3d964166d3f34be57f7d05ca205020/pa/RR38006_f423eff5fba2a99aa12e56690c5b68e1.jpg saved to cache
2026-04-27 07:55:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 047a4dc4-e818-516c-8ab2-d50e1ed7c859
2026-04-27 07:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XE68942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NC63343/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN52810> (referer: https://www.auto1.com/v1/car-details-view/NN52810/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA32540> (referer: https://www.auto1.com/v1/car-details-view/XA32540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CW43001> (referer: https://www.auto1.com/v1/car-details-view/CW43001/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM11859> (referer: https://www.auto1.com/v1/car-details-view/FM11859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64d675e1-6609-5590-b002-d9bc43c9dcc2 with identifier: NN52810
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64d675e1-6609-5590-b002-d9bc43c9dcc2 with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64d675e1-6609-5590-b002-d9bc43c9dcc2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_4a2f8371f16ab2506145b32843aaf563.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_e77705108ea9eb6d87ace8c20f4bcf37.jpg not downloaded yet
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MV31191> (referer: https://www.auto1.com/v1/car-details-view/MV31191/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_f4d071f68353f0ed454e52c188037ccf.jpg not downloaded yet
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_cc39c0511bb8feca1c1cbce62c7d2546.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_5daff18aa724e17e10c2331d5db64b25.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b1df614-1291-5aa5-90c4-5c941b0f4807 with identifier: XA32540
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b1df614-1291-5aa5-90c4-5c941b0f4807 with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b1df614-1291-5aa5-90c4-5c941b0f4807
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_59adb14e6295bc7f936a1184154d8ed5.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_da8b8f30e437a95626e469366eac5a81.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_c9bd23c0e7f5539c0072a566f59c90a0.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f588940-b1cc-5478-81d9-bbb5b862dbf4 with identifier: CW43001
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f588940-b1cc-5478-81d9-bbb5b862dbf4 with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8f588940-b1cc-5478-81d9-bbb5b862dbf4
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/01/4401e1ba7f9d87bd4b1a7dfc320f57d7/pa/CW43001_7d34152323085e51b94c97cb7e14df80.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79aacf3d-b976-5254-b846-1f43057f24f1 with identifier: FM11859
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79aacf3d-b976-5254-b846-1f43057f24f1 with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79aacf3d-b976-5254-b846-1f43057f24f1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_3a32c09806ec8e81d4a5a73c0017d701.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_5f953fd7469975b572dc153126020411.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_9007889a469b5181dc46a90dd049fa2f.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/01/4401e1ba7f9d87bd4b1a7dfc320f57d7/pa/CW43001_5cd920655d9e5101740187083367f6a2.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_1bcbb1c9d07aff405cf5cf7db3968061.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bfa6f11-1b55-5a63-97a3-263007e6399c with identifier: MV31191
2026-04-27 07:55:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bfa6f11-1b55-5a63-97a3-263007e6399c with scrape type 1
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0bfa6f11-1b55-5a63-97a3-263007e6399c
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_827c95362ac2349d1b044c42fa39a276.jpg not downloaded yet
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_e77705108ea9eb6d87ace8c20f4bcf37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_d004348dd65ddece6717e2a94b5b1904.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_3ccc58d583c1fbf6087b554d8e53fce0.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/01/4401e1ba7f9d87bd4b1a7dfc320f57d7/pa/CW43001_178dc102ba9c702beaa057800c6d9e5b.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_ad61fb8a133cf51d762d6234cd9a55d8.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_78a6eff138c51541edd87445044b32d7.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_e94c68f5f880990f9a6c32bda5077a02.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_1dc2dd9651a6b127aa874c0743722979.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/01/4401e1ba7f9d87bd4b1a7dfc320f57d7/pa/CW43001_d2179c5bf79d21b1151eb29c2078314e.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_dec86b7ea81fefe9350b7648b9248988.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_fd8f7440979f2e19948a4a4bba081961.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_28204f02a298efbb9125763da38f5b3d.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_ffb8b9061a54add18fe307ceed48179d.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/01/4401e1ba7f9d87bd4b1a7dfc320f57d7/pa/CW43001_a2b1600a254497ad5dd0b154d400690a.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_953ed49973344cfb872f66be24e59667.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_3615b3385be47f7625531b7bef269c86.jpg not downloaded yet
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_827c95362ac2349d1b044c42fa39a276.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_8cf9fd017aed433a0b5301cffeee4343.jpg not downloaded yet
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ec790>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64d675e1-6609-5590-b002-d9bc43c9dcc2/64d675e1-6609-5590-b002-d9bc43c9dcc2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/08/060877e74521ef53eeecf0adff7ea6ca/pa/NN52810_e77705108ea9eb6d87ace8c20f4bcf37.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64d675e1-6609-5590-b002-d9bc43c9dcc2
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_75f6e34fc5ab02fe142a34bca7e35f80.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_e4f413a6bb0bd1783cdae10b0f5e7777.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_054fd16b6d873ca566b869220371edc1.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_7def485d789094bcf3a58e0ae05d740c.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_03ad05a528eae0f7ebdd7929ae9927ef.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_60bab44c3e8315a7d8f9070e40673f16.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_6519f9814204a41b9fca3144e9482da9.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_b5f2162dc928b780c0e9d88324dd445c.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_7124205686d114c458dd963410ea61fb.jpg not downloaded yet
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5558fd0>
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bfa6f11-1b55-5a63-97a3-263007e6399c/0bfa6f11-1b55-5a63-97a3-263007e6399c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_827c95362ac2349d1b044c42fa39a276.jpg saved to cache
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0bfa6f11-1b55-5a63-97a3-263007e6399c
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_2efe61037e57718c18aba4128276a378.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_a11506574d6d5158e80d7d3496bfb9ab.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_59d3af0bbca627ea9d5dc03b3db0bff8.jpg not downloaded yet
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_027941bf907c20a007ce1c413847c723.jpg not downloaded yet
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV24058/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_ffb8b9061a54add18fe307ceed48179d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_cd69e0ec68ac110c31eb9069d75a2cd2.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af5d90>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b1df614-1291-5aa5-90c4-5c941b0f4807/9b1df614-1291-5aa5-90c4-5c941b0f4807_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/7e/957e2d43cdd4dacbe5f2caf1c20ffc7a/pa/XA32540_ffb8b9061a54add18fe307ceed48179d.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b1df614-1291-5aa5-90c4-5c941b0f4807
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD09696> (referer: https://www.auto1.com/v1/car-details-view/KD09696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_59d3af0bbca627ea9d5dc03b3db0bff8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL44152> (referer: https://www.auto1.com/v1/car-details-view/YL44152/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_027941bf907c20a007ce1c413847c723.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39c87f23-fe0f-53c2-b223-7ae43b1ced25 with identifier: KD09696
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25 with scrape type 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_931dbda37f07e6dd91f5c533c2c1a0e3.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_b43f1d9a805fd8bead1fbfda46dd1f1d.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_9592f20621d469d6279bb03054e24bc1.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6394950>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79aacf3d-b976-5254-b846-1f43057f24f1/79aacf3d-b976-5254-b846-1f43057f24f1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_59d3af0bbca627ea9d5dc03b3db0bff8.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79aacf3d-b976-5254-b846-1f43057f24f1
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_2efe61037e57718c18aba4128276a378.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_a11506574d6d5158e80d7d3496bfb9ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_5635de53198d14f5dc0f57bf1f70436e.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC87069> (referer: https://www.auto1.com/v1/car-details-view/DC87069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_d171c22f9721f0551d61bd55bcfd02a0.jpg not downloaded yet
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e80b6b4-9658-566e-8281-f077edcd6470 with identifier: YL44152
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e80b6b4-9658-566e-8281-f077edcd6470 with scrape type 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_52ec37ef6e72aab2f222a9cccef9ac79.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562b590>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bfa6f11-1b55-5a63-97a3-263007e6399c/0bfa6f11-1b55-5a63-97a3-263007e6399c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_027941bf907c20a007ce1c413847c723.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0bfa6f11-1b55-5a63-97a3-263007e6399c
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_88a4dd2105042a9af3ba0f9ff5f09293.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_b43f1d9a805fd8bead1fbfda46dd1f1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_cd69e0ec68ac110c31eb9069d75a2cd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_91c33ba852758c6e8c4a5f40fa6e1e07.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57fb290>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79aacf3d-b976-5254-b846-1f43057f24f1/79aacf3d-b976-5254-b846-1f43057f24f1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/d6/96d677bfdc5ae55c8a3cdf73f3cc01f8/pa/FM11859_2efe61037e57718c18aba4128276a378.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79aacf3d-b976-5254-b846-1f43057f24f1
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5556050>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bfa6f11-1b55-5a63-97a3-263007e6399c/0bfa6f11-1b55-5a63-97a3-263007e6399c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_a11506574d6d5158e80d7d3496bfb9ab.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0bfa6f11-1b55-5a63-97a3-263007e6399c
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XM57641> (referer: https://www.auto1.com/v1/car-details-view/XM57641/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9aecf583-ee02-5d92-bbd8-893bb1a69269 with identifier: DC87069
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9aecf583-ee02-5d92-bbd8-893bb1a69269 with scrape type 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8a40c84a8ad56a505748fbbdf56a8e3c.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_5635de53198d14f5dc0f57bf1f70436e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_d81057905faa065f9cc2b07939f767f1.jpg not downloaded yet
2026-04-27 07:55:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_9592f20621d469d6279bb03054e24bc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8d20375892dd9947966ee3e082f71b5d.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63bb550>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c87f23-fe0f-53c2-b223-7ae43b1ced25/39c87f23-fe0f-53c2-b223-7ae43b1ced25_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_b43f1d9a805fd8bead1fbfda46dd1f1d.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b36d0>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0bfa6f11-1b55-5a63-97a3-263007e6399c/0bfa6f11-1b55-5a63-97a3-263007e6399c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/bd/e6bd1a2b194829d799ccb47850e0ec28/pa/MV31191_cd69e0ec68ac110c31eb9069d75a2cd2.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0bfa6f11-1b55-5a63-97a3-263007e6399c
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1fce2f3bd38421b8a0abf32d90d093cc.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_f327293ea88073e38476fbdc84be07fd.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_52ec37ef6e72aab2f222a9cccef9ac79.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_c992a21fd69ada86aee5c1de77611e6b.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0aad052-2232-5758-83c6-74222214bbd2 with identifier: XM57641
2026-04-27 07:55:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0aad052-2232-5758-83c6-74222214bbd2 with scrape type 1
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d0aad052-2232-5758-83c6-74222214bbd2
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0129474686a5b9ffbbd1d70ad77f5c45.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5699d90>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c87f23-fe0f-53c2-b223-7ae43b1ced25/39c87f23-fe0f-53c2-b223-7ae43b1ced25_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_5635de53198d14f5dc0f57bf1f70436e.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c6cd0>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c87f23-fe0f-53c2-b223-7ae43b1ced25/39c87f23-fe0f-53c2-b223-7ae43b1ced25_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_9592f20621d469d6279bb03054e24bc1.jpg saved to cache
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_1ec33070b8771b6dfb2466f1c43ecebc.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_91c33ba852758c6e8c4a5f40fa6e1e07.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1f1bda7e347fc04096a11fb503ee69ff.jpg not downloaded yet
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_c02cb553860db3fca41ce578a71880ec.jpg not downloaded yet
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_d171c22f9721f0551d61bd55bcfd02a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_88a4dd2105042a9af3ba0f9ff5f09293.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_6824245c9a61396f8476874f7cb72d4b.jpg not downloaded yet
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551f850>
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_52ec37ef6e72aab2f222a9cccef9ac79.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_b28c10f9dfc71f7b451a1a5e7cbe24fc.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0128c6dadc1730ee39236611a0030d75.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8a40c84a8ad56a505748fbbdf56a8e3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_456a5b2931f534c859d23f01f24a63c8.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1cd64def791b78db31c8477253e4dc26.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_50b4e982924755e8a7c1aaeca12444d3.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SP11611> (referer: https://www.auto1.com/v1/car-details-view/SP11611/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8d62563de4319518628a7437e0690e67.jpg not downloaded yet
2026-04-27 07:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_1ec33070b8771b6dfb2466f1c43ecebc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_a8030310acc1dc2b06a3961b4bd4b3a5.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_e34824a0f708f66f07fa847118c3075d.jpg not downloaded yet
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a4b210>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_91c33ba852758c6e8c4a5f40fa6e1e07.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c98d0>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_39c87f23-fe0f-53c2-b223-7ae43b1ced25/39c87f23-fe0f-53c2-b223-7ae43b1ced25_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/c7/9ec7547ae466339278a09cfe35765dea/pa/KD09696_d171c22f9721f0551d61bd55bcfd02a0.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 39c87f23-fe0f-53c2-b223-7ae43b1ced25
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a4c10>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_88a4dd2105042a9af3ba0f9ff5f09293.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0129474686a5b9ffbbd1d70ad77f5c45.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_3fcbb3bed715276bbb4c0306575593c4.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1fce2f3bd38421b8a0abf32d90d093cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_c992a21fd69ada86aee5c1de77611e6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_a5314128b0149c03385fb02eb8c42ca5.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AJ06383> (referer: https://www.auto1.com/v1/car-details-view/AJ06383/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ29164> (referer: https://www.auto1.com/v1/car-details-view/DJ29164/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a89b90>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8a40c84a8ad56a505748fbbdf56a8e3c.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d6c4abf-f591-5068-b141-62c97b587827 with identifier: SP11611
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d6c4abf-f591-5068-b141-62c97b587827 with scrape type 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_025402308e12bba12dff28a90309ed6b.jpg not downloaded yet
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af050>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_1ec33070b8771b6dfb2466f1c43ecebc.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0128c6dadc1730ee39236611a0030d75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_690b9e8ab27fb43f8e41b860b2935c84.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_cf934b9dee4b3bbd9c0cd51e895c3585.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF81124> (referer: https://www.auto1.com/v1/car-details-view/AF81124/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead570a610>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0aad052-2232-5758-83c6-74222214bbd2/d0aad052-2232-5758-83c6-74222214bbd2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0129474686a5b9ffbbd1d70ad77f5c45.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0aad052-2232-5758-83c6-74222214bbd2
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5965410>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1fce2f3bd38421b8a0abf32d90d093cc.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d1590>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_c992a21fd69ada86aee5c1de77611e6b.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c191d393-416f-5ec1-989e-a4350c7007da with identifier: AJ06383
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c191d393-416f-5ec1-989e-a4350c7007da with scrape type 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c191d393-416f-5ec1-989e-a4350c7007da
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_573337a6a0cea483f8eab0b2834901c2.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df56f1d1-8d49-5c67-8ed1-929d888fc789 with identifier: DJ29164
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df56f1d1-8d49-5c67-8ed1-929d888fc789 with scrape type 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cf630a112cbc71fc4232ac6567555d41.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_50b4e982924755e8a7c1aaeca12444d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8d62563de4319518628a7437e0690e67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_7a3851b84bf100de6588665868e2c7ad.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_3fcbb3bed715276bbb4c0306575593c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_e34824a0f708f66f07fa847118c3075d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_9fd77225c588e077eb2759fe227b9789.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cebc11865c3b2cf617ee8f0b452973c2.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_456a5b2931f534c859d23f01f24a63c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_80ab0b6a99b4a14bec051562138c1502.jpg not downloaded yet
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NC63343> (referer: https://www.auto1.com/v1/car-details-view/NC63343/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_a8030310acc1dc2b06a3961b4bd4b3a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_fdd6f0c23c53fdc17d76d895eaf15712.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_44a69d23e9f23e98352ae2d220173276.jpg not downloaded yet
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c1b10>
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0aad052-2232-5758-83c6-74222214bbd2/d0aad052-2232-5758-83c6-74222214bbd2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_0128c6dadc1730ee39236611a0030d75.jpg saved to cache
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0aad052-2232-5758-83c6-74222214bbd2
2026-04-27 07:55:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97619b1d-d53a-50c3-9f69-d2f4bf3316d6 with identifier: AF81124
2026-04-27 07:55:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6 with scrape type 1
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f722a3be7e5b02b1bbe3f8f211a7199b.jpg not downloaded yet
2026-04-27 07:55:24 [auto1.it] INFO: Channel: 24h | Page: 3 | totalHits: 3096 | hits on page: 40
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_025402308e12bba12dff28a90309ed6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1cd64def791b78db31c8477253e4dc26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_aba6d8189fe2b4a358a0fae22d908b1e.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_a6ca18bcb8b76d5b066277070041a82c.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_c77273cabedd7f148ee537f86e4e0dcc.jpg not downloaded yet
2026-04-27 07:55:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f002e5cbb4b14dfb577acf6bbd3a324d.jpg not downloaded yet
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: JF91368
2026-04-27 07:55:24 [auto1.it] INFO: Scrape type for JF91368: 0
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: BR92106
2026-04-27 07:55:24 [auto1.it] INFO: Scrape type for BR92106: 0
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: DL48698
2026-04-27 07:55:24 [auto1.it] INFO: Scrape type for DL48698: 0
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: BF48403
2026-04-27 07:55:24 [auto1.it] INFO: Scrape type for BF48403: 0
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: TW78550
2026-04-27 07:55:24 [auto1.it] INFO: Scrape type for TW78550: 0
2026-04-27 07:55:24 [auto1.it] INFO: Found listing with ID: YM60630
2026-04-27 07:55:25 [auto1.it] INFO: Scrape type for YM60630: 1
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_a5314128b0149c03385fb02eb8c42ca5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_573337a6a0cea483f8eab0b2834901c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cf630a112cbc71fc4232ac6567555d41.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_690b9e8ab27fb43f8e41b860b2935c84.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_cf934b9dee4b3bbd9c0cd51e895c3585.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_d19276353182d4f54354b23c509b8290.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC21140/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_b7495e42351019c00e75330e7cebe222.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_adab5caecf3d709fd893a5a5f033fd74.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_e8df800956753ce3a93cca01715fd886.jpg not downloaded yet
2026-04-27 07:55:25 [auto1.it] INFO: Found listing with ID: KW35256
2026-04-27 07:55:25 [auto1.it] INFO: Scrape type for KW35256: 1
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58da410>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0aad052-2232-5758-83c6-74222214bbd2/d0aad052-2232-5758-83c6-74222214bbd2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_50b4e982924755e8a7c1aaeca12444d3.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0aad052-2232-5758-83c6-74222214bbd2
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5959610>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_8d62563de4319518628a7437e0690e67.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f5c50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_3fcbb3bed715276bbb4c0306575593c4.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6b50>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0aad052-2232-5758-83c6-74222214bbd2/d0aad052-2232-5758-83c6-74222214bbd2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/18/fd18707a3d1b57579e23a1c73b76a7ff/pa/XM57641_e34824a0f708f66f07fa847118c3075d.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0aad052-2232-5758-83c6-74222214bbd2
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f42d0>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_456a5b2931f534c859d23f01f24a63c8.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4726a85-bc1d-5637-8258-40964964ca95 with identifier: NC63343
2026-04-27 07:55:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4726a85-bc1d-5637-8258-40964964ca95 with scrape type 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_6f53c394a7845a81e18ac1cea02ed95d.jpg not downloaded yet
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d050>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_a8030310acc1dc2b06a3961b4bd4b3a5.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_b28c10f9dfc71f7b451a1a5e7cbe24fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_7a3851b84bf100de6588665868e2c7ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_fa47f8a0da956aa7a1447e6b1c918a15.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XE68942> (referer: https://www.auto1.com/v1/car-details-view/XE68942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5637850>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_025402308e12bba12dff28a90309ed6b.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5654790>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_1cd64def791b78db31c8477253e4dc26.jpg saved to cache
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_9fd77225c588e077eb2759fe227b9789.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f722a3be7e5b02b1bbe3f8f211a7199b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cebc11865c3b2cf617ee8f0b452973c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_5647c570a92d16439cc926b677a4750a.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_e05c5d1a66ac9853b75c2b3116178fb4.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_0d95e82af5574a79887892005a144b66.jpg not downloaded yet
2026-04-27 07:55:25 [auto1.it] INFO: Found listing with ID: EC20535
2026-04-27 07:55:25 [auto1.it] INFO: Scrape type for EC20535: 1
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1be73857b133b5e474c21e67321a08c9.jpg not downloaded yet
2026-04-27 07:55:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_97ef8a4d8bd30f51761840b6e8aeee90.jpg not downloaded yet
2026-04-27 07:55:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK70633> (referer: https://www.auto1.com/v1/car-details-view/PK70633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696390>
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_a5314128b0149c03385fb02eb8c42ca5.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568cf90>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c191d393-416f-5ec1-989e-a4350c7007da/c191d393-416f-5ec1-989e-a4350c7007da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_573337a6a0cea483f8eab0b2834901c2.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c191d393-416f-5ec1-989e-a4350c7007da
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c7e90>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df56f1d1-8d49-5c67-8ed1-929d888fc789/df56f1d1-8d49-5c67-8ed1-929d888fc789_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cf630a112cbc71fc4232ac6567555d41.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5625210>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_690b9e8ab27fb43f8e41b860b2935c84.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5150>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_cf934b9dee4b3bbd9c0cd51e895c3585.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_6824245c9a61396f8476874f7cb72d4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_aba6d8189fe2b4a358a0fae22d908b1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_44a69d23e9f23e98352ae2d220173276.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_d8761f5ff8e5d216efcc4711d538325f.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_6f1cf2c4a55e70ce61f206b703647611.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_7280ea955e534d20518b17fa395047da.jpg not downloaded yet
2026-04-27 07:55:26 [auto1.it] INFO: Found listing with ID: GG13380
2026-04-27 07:55:26 [auto1.it] INFO: Scrape type for GG13380: 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_cdb4e8d2fa20411d16c28510bd1b39c6.jpg not downloaded yet
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_80ab0b6a99b4a14bec051562138c1502.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_fdd6f0c23c53fdc17d76d895eaf15712.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_401a89da754b5ab991f5b5bb78b4963b.jpg not downloaded yet
2026-04-27 07:55:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV24058> (referer: https://www.auto1.com/v1/car-details-view/BV24058/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a5a90>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e80b6b4-9658-566e-8281-f077edcd6470/1e80b6b4-9658-566e-8281-f077edcd6470_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img45/61/4561427a83852b017b40bd745fb994cb/pa/YL44152_b28c10f9dfc71f7b451a1a5e7cbe24fc.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e80b6b4-9658-566e-8281-f077edcd6470
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568e050>
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_7a3851b84bf100de6588665868e2c7ad.jpg saved to cache
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f42ba3-1afd-5859-840e-ccb1e270dfb1 with identifier: XE68942
2026-04-27 07:55:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1 with scrape type 1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_460bd4c9c0a57253b52cdf742727cc06.jpg not downloaded yet
2026-04-27 07:55:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_0b827e2ce4a4defb4a55bdef1d71c0ab.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_ca470ca3ee39db139785e4db1735a18e.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.it] INFO: Found listing with ID: VB18666
2026-04-27 07:55:27 [auto1.it] INFO: Scrape type for VB18666: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_456affea1e5499f16c698f6bc7461fa8.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YA50042> (referer: https://www.auto1.com/v1/car-details-view/YA50042/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5695890>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c191d393-416f-5ec1-989e-a4350c7007da/c191d393-416f-5ec1-989e-a4350c7007da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_9fd77225c588e077eb2759fe227b9789.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c191d393-416f-5ec1-989e-a4350c7007da
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6342d50>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97619b1d-d53a-50c3-9f69-d2f4bf3316d6/97619b1d-d53a-50c3-9f69-d2f4bf3316d6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f722a3be7e5b02b1bbe3f8f211a7199b.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5678150>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df56f1d1-8d49-5c67-8ed1-929d888fc789/df56f1d1-8d49-5c67-8ed1-929d888fc789_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_cebc11865c3b2cf617ee8f0b452973c2.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e288fa-6363-5063-b6b5-569f5697dc88 with identifier: PK70633
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e288fa-6363-5063-b6b5-569f5697dc88 with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_86e0423cea584f079081d52f170de71f.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f002e5cbb4b14dfb577acf6bbd3a324d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_d19276353182d4f54354b23c509b8290.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_fa47f8a0da956aa7a1447e6b1c918a15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_e8df800956753ce3a93cca01715fd886.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_83d5e90ef101feb2f51373ddd3e16ba8.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_dee278d1856e4a66afd1fe975c072c29.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_0d95e82af5574a79887892005a144b66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_6f53c394a7845a81e18ac1cea02ed95d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_a1f7a48e599aa59a37e4ed10e2ada0d0.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_ed55836610e2b5022d90f192a24eabb7.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.it] INFO: Found listing with ID: UD98001
2026-04-27 07:55:27 [auto1.it] INFO: Scrape type for UD98001: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_3513790e9c06240b52ca17be440c3668.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_5808476073a2fea782ea6fd5d8cd20ba.jpg not downloaded yet
2026-04-27 07:55:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58723d0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9aecf583-ee02-5d92-bbd8-893bb1a69269/9aecf583-ee02-5d92-bbd8-893bb1a69269_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img22/ee/22eec1868aefe8cce5cc7729881bc398/pa/DC87069_6824245c9a61396f8476874f7cb72d4b.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9aecf583-ee02-5d92-bbd8-893bb1a69269
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead558fcd0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_aba6d8189fe2b4a358a0fae22d908b1e.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a5d50>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df56f1d1-8d49-5c67-8ed1-929d888fc789/df56f1d1-8d49-5c67-8ed1-929d888fc789_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_44a69d23e9f23e98352ae2d220173276.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55b7290>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_80ab0b6a99b4a14bec051562138c1502.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bb690>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c191d393-416f-5ec1-989e-a4350c7007da/c191d393-416f-5ec1-989e-a4350c7007da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_fdd6f0c23c53fdc17d76d895eaf15712.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c191d393-416f-5ec1-989e-a4350c7007da
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55e923c4-57d3-5838-8214-b119735d7cdc with identifier: BV24058
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55e923c4-57d3-5838-8214-b119735d7cdc with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 55e923c4-57d3-5838-8214-b119735d7cdc
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_5a68996a20b870f79e0457ecf15adafe.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1be73857b133b5e474c21e67321a08c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_e05c5d1a66ac9853b75c2b3116178fb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_581fad4d8e7330f9cc5aafe073186e21.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_7bf57340dcc3f718f9802258ecac2e9a.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_501f01ba79cee1e084a04f0b100840b4.jpg not downloaded yet
2026-04-27 07:55:27 [auto1.it] INFO: Found listing with ID: ST62394
2026-04-27 07:55:27 [auto1.it] INFO: Scrape type for ST62394: 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_da180db3f8883ceca4b18dc8920ffa31.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_1964b1650b50fb3d64a32eb829504bb6.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_341d514fcbf80a8ad8bb79649699a914.jpg not downloaded yet
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_62eaedf9a84ed2e4b773b91888f5a4b0.jpg not downloaded yet
2026-04-27 07:55:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM60630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3982b770-4266-551b-94ba-ae8149929f8e with identifier: YA50042
2026-04-27 07:55:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3982b770-4266-551b-94ba-ae8149929f8e with scrape type 1
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_5c6dc09a61548b624cfa115844e27195.jpg not downloaded yet
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5596bd0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97619b1d-d53a-50c3-9f69-d2f4bf3316d6/97619b1d-d53a-50c3-9f69-d2f4bf3316d6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_f002e5cbb4b14dfb577acf6bbd3a324d.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b09d0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_d19276353182d4f54354b23c509b8290.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59a4bd0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_fa47f8a0da956aa7a1447e6b1c918a15.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95990>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97619b1d-d53a-50c3-9f69-d2f4bf3316d6/97619b1d-d53a-50c3-9f69-d2f4bf3316d6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_e8df800956753ce3a93cca01715fd886.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55cb3d0>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97619b1d-d53a-50c3-9f69-d2f4bf3316d6/97619b1d-d53a-50c3-9f69-d2f4bf3316d6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/8c/c48cb9802a4902cf6c7598ef1f36b65a/pa/AF81124_0d95e82af5574a79887892005a144b66.jpg saved to cache
2026-04-27 07:55:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97619b1d-d53a-50c3-9f69-d2f4bf3316d6
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645fe50>
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_6f53c394a7845a81e18ac1cea02ed95d.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:28 [auto1.it] INFO: Found listing with ID: BS94262
2026-04-27 07:55:28 [auto1.it] INFO: Scrape type for BS94262: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_40ce70edb14b93d9b74f82762aeb84d2.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c709f4a7dff2444b5e9d1a6cd984f37c.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_888ed171b305ccc7219c2c2e3062d967.jpg not downloaded yet
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_460bd4c9c0a57253b52cdf742727cc06.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_ca470ca3ee39db139785e4db1735a18e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_401a89da754b5ab991f5b5bb78b4963b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_86e0423cea584f079081d52f170de71f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_69ea62adced5863813d37f7ccfe9ea6f.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_19a7d351f63ab3a707d1d6cf023bc6d0.jpg not downloaded yet
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_456affea1e5499f16c698f6bc7461fa8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_97ef8a4d8bd30f51761840b6e8aeee90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_cdb4e8d2fa20411d16c28510bd1b39c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_0b827e2ce4a4defb4a55bdef1d71c0ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:28 [auto1.it] INFO: Found listing with ID: AU28859
2026-04-27 07:55:28 [auto1.it] INFO: Scrape type for AU28859: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_8109240a8833cda1a71b28a5fd74efe2.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_21ecc0424dfa5093805629b9def215c2.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_1bc4832eccc3284d8201c000fe43e23e.jpg not downloaded yet
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58883d0>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1be73857b133b5e474c21e67321a08c9.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5754c90>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df56f1d1-8d49-5c67-8ed1-929d888fc789/df56f1d1-8d49-5c67-8ed1-929d888fc789_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_e05c5d1a66ac9853b75c2b3116178fb4.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_a2ec9aa1592a2d3ee18cad6afd4ffbe4.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_79ee1f3972f4a35e04353e18b21940b4.jpg not downloaded yet
2026-04-27 07:55:28 [auto1.it] INFO: Found listing with ID: ZE60733
2026-04-27 07:55:28 [auto1.it] INFO: Scrape type for ZE60733: 1
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_260f0a3a2e48ceeebf92a5d3815a086a.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_fda8c40e2abe9e10c881c97fde4d77dd.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_bc48772faaeb33f008dbc8c574637527.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_7dffe054da157ee562046f031f42d6cd.jpg not downloaded yet
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_77eb697df3d7c2b4bd9958db218b8220.jpg not downloaded yet
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56af4d0>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f42ba3-1afd-5859-840e-ccb1e270dfb1/37f42ba3-1afd-5859-840e-ccb1e270dfb1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_460bd4c9c0a57253b52cdf742727cc06.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5836b10>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df56f1d1-8d49-5c67-8ed1-929d888fc789/df56f1d1-8d49-5c67-8ed1-929d888fc789_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/71/f6717d0f4ce46a29cd150bc5d763d490/pa/DJ29164_ca470ca3ee39db139785e4db1735a18e.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df56f1d1-8d49-5c67-8ed1-929d888fc789
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f8710>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_401a89da754b5ab991f5b5bb78b4963b.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6384510>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_86e0423cea584f079081d52f170de71f.jpg saved to cache
2026-04-27 07:55:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:28 [auto1.it] INFO: Channel: 24h | Page: 4 | totalHits: 3096 | hits on page: 40
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c71d0>
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_456affea1e5499f16c698f6bc7461fa8.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a48450>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_97ef8a4d8bd30f51761840b6e8aeee90.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58728d0>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_cdb4e8d2fa20411d16c28510bd1b39c6.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a6fe90>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c191d393-416f-5ec1-989e-a4350c7007da/c191d393-416f-5ec1-989e-a4350c7007da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/e5/98e55e2a1993b3eec0c4d44a563d0bf7/pa/AJ06383_0b827e2ce4a4defb4a55bdef1d71c0ab.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c191d393-416f-5ec1-989e-a4350c7007da
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_62eaedf9a84ed2e4b773b91888f5a4b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_83d5e90ef101feb2f51373ddd3e16ba8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: NC13988
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for NC13988: 1
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1d23090a5107e1827b12764a00c7aaf7.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_d35b346e2d2dac6b6b29c1deb9b40472.jpg not downloaded yet
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_888ed171b305ccc7219c2c2e3062d967.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_dee278d1856e4a66afd1fe975c072c29.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_341d514fcbf80a8ad8bb79649699a914.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c709f4a7dff2444b5e9d1a6cd984f37c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_40ce70edb14b93d9b74f82762aeb84d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_1c7fd426d278ff248661c51a53515b77.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_88c8fb5585c63e7fbb2d958c2adbf460.jpg not downloaded yet
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: BK72599
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for BK72599: 1
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW35256/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC20535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: NV14531
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for NV14531: 1
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_3e8d25f4f8890db7b4033ad55868beeb.jpg not downloaded yet
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB18666/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC21140> (referer: https://www.auto1.com/v1/car-details-view/LC21140/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_faf5bf4b4129051573e7034e674bd3db.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_bc440823215dd7fe4b131ccc79bff279.jpg not downloaded yet
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: UZ83014
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for UZ83014: 1
2026-04-27 07:55:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: FF54674
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for FF54674: 1
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c4bfe955a15d12f661f0770360975605.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_f319ee63ad10e8dfbd5e9bd2155d2159.jpg not downloaded yet
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_e08a81071217bdb5b0e033ab0ec50792.jpg not downloaded yet
2026-04-27 07:55:29 [auto1.it] INFO: Found listing with ID: LZ09270
2026-04-27 07:55:29 [auto1.it] INFO: Scrape type for LZ09270: 1
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6348910>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f42ba3-1afd-5859-840e-ccb1e270dfb1/37f42ba3-1afd-5859-840e-ccb1e270dfb1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_62eaedf9a84ed2e4b773b91888f5a4b0.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58734d0>
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_83d5e90ef101feb2f51373ddd3e16ba8.jpg saved to cache
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d6c4abf-f591-5068-b141-62c97b587827
2026-04-27 07:55:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d6c4abf-f591-5068-b141-62c97b587827, skipping ID generation
2026-04-27 07:55:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d6c4abf-f591-5068-b141-62c97b587827 with scrape type 1
2026-04-27 07:55:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d6c4abf-f591-5068-b141-62c97b587827 sending to next pipeline
2026-04-27 07:55:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d6c4abf-f591-5068-b141-62c97b587827, identifier: SP11611
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: HR92713
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for HR92713: 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_6d1d28b704388427c30eff7cfb34158c.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d6c4abf-f591-5068-b141-62c97b587827 with identifier: SP11611
2026-04-27 07:55:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d6c4abf-f591-5068-b141-62c97b587827 with identifier: SP11611
2026-04-27 07:55:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d6c4abf-f591-5068-b141-62c97b587827 with identifier: SP11611 to the API
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_83d5e90ef101feb2f51373ddd3e16ba8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:06:24Z',
'fuel_type': 'petrol',
'id': '1d6c4abf-f591-5068-b141-62c97b587827',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SP11611',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 93019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78707,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_025402308e12bba12dff28a90309ed6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77757,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_cf934b9dee4b3bbd9c0cd51e895c3585.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_7a3851b84bf100de6588665868e2c7ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_80ab0b6a99b4a14bec051562138c1502.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_aba6d8189fe2b4a358a0fae22d908b1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_d19276353182d4f54354b23c509b8290.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_fa47f8a0da956aa7a1447e6b1c918a15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_97ef8a4d8bd30f51761840b6e8aeee90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_401a89da754b5ab991f5b5bb78b4963b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d6c4abf-f591-5068-b141-62c97b587827/1d6c4abf-f591-5068-b141-62c97b587827_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img66/e8/66e89595d8a5e82f116fb1aa6af95d38/pa/SP11611_83d5e90ef101feb2f51373ddd3e16ba8.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2015-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 200 BlueEfficiency Urban',
'transmission': 'automatic',
'trim': 'BlueEfficiency Urban',
'year': 2015}
2026-04-27 07:55:30 [auto1.it] INFO: Saving data for SP11611: {'created_time': 1777276530.420681, 'last_price_update_time': 1777276530.420694, 'has_photos': True, 'auction_closing_time': 1777388784.0}
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_7dffe054da157ee562046f031f42d6cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_7e395a231f96f69bce442b08f147e2ee.jpg not downloaded yet
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: VD44322
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for VD44322: 1
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_1964b1650b50fb3d64a32eb829504bb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_da180db3f8883ceca4b18dc8920ffa31.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_bc48772faaeb33f008dbc8c574637527.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_260f0a3a2e48ceeebf92a5d3815a086a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_fda8c40e2abe9e10c881c97fde4d77dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: WL53741
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for WL53741: 1
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a6c50>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e923c4-57d3-5838-8214-b119735d7cdc/55e923c4-57d3-5838-8214-b119735d7cdc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_888ed171b305ccc7219c2c2e3062d967.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55e923c4-57d3-5838-8214-b119735d7cdc
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b2510>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f42ba3-1afd-5859-840e-ccb1e270dfb1/37f42ba3-1afd-5859-840e-ccb1e270dfb1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_dee278d1856e4a66afd1fe975c072c29.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586c310>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e923c4-57d3-5838-8214-b119735d7cdc/55e923c4-57d3-5838-8214-b119735d7cdc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_341d514fcbf80a8ad8bb79649699a914.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55e923c4-57d3-5838-8214-b119735d7cdc
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5555710>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c709f4a7dff2444b5e9d1a6cd984f37c.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a70ed0>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_40ce70edb14b93d9b74f82762aeb84d2.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 126dc117-0180-57b3-9abb-cb76bf798535 with identifier: LC21140
2026-04-27 07:55:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126dc117-0180-57b3-9abb-cb76bf798535 with scrape type 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_18c6b238e1e2b16c15a16ca264dd2924.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_cc05c630b6ba1a3d000bb25bffff9e7b.jpg not downloaded yet
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: ZW92714
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for ZW92714: 1
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: PN84463
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for PN84463: 1
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_d1bd03f528bceb9f30a75c44605a0c2d.jpg not downloaded yet
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_230b1e151a1969113195ca092dbba04e.jpg not downloaded yet
2026-04-27 07:55:30 [auto1.it] INFO: Found listing with ID: NB44357
2026-04-27 07:55:30 [auto1.it] INFO: Scrape type for NB44357: 1
2026-04-27 07:55:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST62394/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55550d0>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f42ba3-1afd-5859-840e-ccb1e270dfb1/37f42ba3-1afd-5859-840e-ccb1e270dfb1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_7dffe054da157ee562046f031f42d6cd.jpg saved to cache
2026-04-27 07:55:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x00\x01'
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 34 - Data Location: 74 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 46 - Data Location: 82 - value: b'\x00\x00\x00H\x00\x00\x00\x01'
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x00\x02'
2026-04-27 07:55:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00Z'
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dc150>
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_1964b1650b50fb3d64a32eb829504bb6.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c12d0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_da180db3f8883ceca4b18dc8920ffa31.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dfdd0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55e923c4-57d3-5838-8214-b119735d7cdc/55e923c4-57d3-5838-8214-b119735d7cdc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/4f/9b4f3ae208481dade7b521b4dc73b736/pa/BV24058_bc48772faaeb33f008dbc8c574637527.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55e923c4-57d3-5838-8214-b119735d7cdc
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55dbd90>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_260f0a3a2e48ceeebf92a5d3815a086a.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a6d550>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_fda8c40e2abe9e10c881c97fde4d77dd.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: AT32399
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for AT32399: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c8dc7ec068ca9cfe959c76f8ec8fb612.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_f319ee63ad10e8dfbd5e9bd2155d2159.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_6d1d28b704388427c30eff7cfb34158c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: SV14181
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for SV14181: 1
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS94262/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1d23090a5107e1827b12764a00c7aaf7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_d35b346e2d2dac6b6b29c1deb9b40472.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: MK90568
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for MK90568: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_1da53ea7e1a370a4e03839a260e2fd42.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_e08a81071217bdb5b0e033ab0ec50792.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: TA79833
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for TA79833: 1
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: YW47316
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for YW47316: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_ca90590463d368d0651406f45b6bca1a.jpg not downloaded yet
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: SW25122
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for SW25122: 1
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c4bfe955a15d12f661f0770360975605.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: FF83172
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for FF83172: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_a35f9586ed4b1b6341148f6d8946fda4.jpg not downloaded yet
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: RJ89863
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for RJ89863: 1
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ace90>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f42ba3-1afd-5859-840e-ccb1e270dfb1/37f42ba3-1afd-5859-840e-ccb1e270dfb1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/24/1c24a80dd5358144adb81fa74fe7ac8d/pa/XE68942_f319ee63ad10e8dfbd5e9bd2155d2159.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37f42ba3-1afd-5859-840e-ccb1e270dfb1
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564e690>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_6d1d28b704388427c30eff7cfb34158c.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_d1bd03f528bceb9f30a75c44605a0c2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: EF18991
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for EF18991: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c2d46dd4eb53e251cd814efd0956db2a.jpg not downloaded yet
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: HW42540
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for HW42540: 1
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557ddd0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4726a85-bc1d-5637-8258-40964964ca95/c4726a85-bc1d-5637-8258-40964964ca95_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/f3/40f39f19d5b2a76a322280369196c4d9/pa/NC63343_1d23090a5107e1827b12764a00c7aaf7.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c4726a85-bc1d-5637-8258-40964964ca95
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64afb90>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_d35b346e2d2dac6b6b29c1deb9b40472.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead558b590>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_e08a81071217bdb5b0e033ab0ec50792.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c8dc7ec068ca9cfe959c76f8ec8fb612.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: RZ82941
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for RZ82941: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_877d45f3de67c0a923bc8b9fc002d286.jpg not downloaded yet
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5867e10>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e288fa-6363-5063-b6b5-569f5697dc88/57e288fa-6363-5063-b6b5-569f5697dc88_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd4/e0/d4e0713c750c9f2a530dffd28f3c48b9/pa/PK70633_c4bfe955a15d12f661f0770360975605.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57e288fa-6363-5063-b6b5-569f5697dc88
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: HD90856
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for HD90856: 1
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BK72599/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: AV12122
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for AV12122: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_efbcd13d2de6dc65941abe1f80312189.jpg not downloaded yet
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632cbd0>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_d1bd03f528bceb9f30a75c44605a0c2d.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: XZ72452
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for XZ72452: 1
2026-04-27 07:55:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: PN94026
2026-04-27 07:55:31 [auto1.it] INFO: Scrape type for PN94026: 1
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_6d74a0ff83facb1522af75d9b322a869.jpg not downloaded yet
2026-04-27 07:55:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE60733/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e3690>
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c8dc7ec068ca9cfe959c76f8ec8fb612.jpg saved to cache
2026-04-27 07:55:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:31 [auto1.it] INFO: Found listing with ID: HY12574
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for HY12574: 1
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HR92713/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: VM60926
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for VM60926: 1
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_a35f9586ed4b1b6341148f6d8946fda4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c2d46dd4eb53e251cd814efd0956db2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: HZ27868
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for HZ27868: 1
2026-04-27 07:55:32 [auto1.it] INFO: Channel: 24h | Page: 5 | totalHits: 3096 | hits on page: 40
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: NV81520
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for NV81520: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: WD20154
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for WD20154: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: VA51604
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for VA51604: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_877d45f3de67c0a923bc8b9fc002d286.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: WG36727
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for WG36727: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: AG45482
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for AG45482: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: MJ76362
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for MJ76362: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: MS56995
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for MS56995: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: PV47203
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for PV47203: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: LT05418
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for LT05418: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: JT21466
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for JT21466: 1
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553d510>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_a35f9586ed4b1b6341148f6d8946fda4.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b1550>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c2d46dd4eb53e251cd814efd0956db2a.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: AF81201
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for AF81201: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: YP09889
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for YP09889: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_6d74a0ff83facb1522af75d9b322a869.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: KC73163
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for KC73163: 1
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645fed0>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_877d45f3de67c0a923bc8b9fc002d286.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: PK33610
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for PK33610: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: LU21739
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for LU21739: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: FX34637
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for FX34637: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: GR59213
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for GR59213: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: XV36287
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for XV36287: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: HH07211
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for HH07211: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AT32399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: VT66321
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for VT66321: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: HH85669
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for HH85669: 1
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: ZV11200
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for ZV11200: 1
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f6990>
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_6d74a0ff83facb1522af75d9b322a869.jpg saved to cache
2026-04-27 07:55:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: GV61096
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for GV61096: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: LG98930
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for LG98930: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: AB63446
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for AB63446: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: UX19423
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for UX19423: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: DN95264
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for DN95264: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NB44357/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: VS63057
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for VS63057: 1
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: SV09218
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for SV09218: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: XA26135
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for XA26135: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: CY79694
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for CY79694: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: FM45145
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for FM45145: 1
2026-04-27 07:55:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV14181/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: XA12696
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for XA12696: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: PM85940
2026-04-27 07:55:32 [auto1.it] INFO: Scrape type for PM85940: 1
2026-04-27 07:55:32 [auto1.it] INFO: Found listing with ID: XV61948
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for XV61948: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: RU88902
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for RU88902: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: LT53678
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for LT53678: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: SE24006
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for SE24006: 1
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ09270/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD90856/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XZ72452/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW25122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: TH50726
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for TH50726: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: PP94333
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for PP94333: 1
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: GF55084
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for GF55084: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: TD15526
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for TD15526: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: KC22557
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for KC22557: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: UW74676
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for UW74676: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: VK61820
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for VK61820: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: VX22650
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for VX22650: 1
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_230b1e151a1969113195ca092dbba04e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: AY32045
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for AY32045: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: EW44732
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for EW44732: 1
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_77eb697df3d7c2b4bd9958db218b8220.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: VP82069
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for VP82069: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: VB21565
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for VB21565: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: BS51992
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for BS51992: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: EZ84220
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for EZ84220: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: PP81137
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for PP81137: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: DR60838
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for DR60838: 1
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN84463/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: RU45122
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for RU45122: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: GN40589
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for GN40589: 1
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x000{\xf5\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x03|~\x000?\x16\x00\x00\x00\x00'
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0fe10>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_9.mpo HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_230b1e151a1969113195ca092dbba04e.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: XL05283
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for XL05283: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: XF01774
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for XF01774: 1
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-04-27 07:55:33 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00D7\x10\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\xa4"\x00C\xfc\xce\x00\x00\x00\x00'
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593d450>
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_3.mpo HTTP/1.1" 201 0
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_77eb697df3d7c2b4bd9958db218b8220.jpg saved to cache
2026-04-27 07:55:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: XJ02099
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for XJ02099: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: LZ51776
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for LZ51776: 1
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PN94026/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: TU31617
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for TU31617: 1
2026-04-27 07:55:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_5c6dc09a61548b624cfa115844e27195.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: SA42409
2026-04-27 07:55:33 [auto1.it] INFO: Scrape type for SA42409: 1
2026-04-27 07:55:33 [auto1.it] INFO: Found listing with ID: NM97698
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for NM97698: 1
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HY12574/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: YV30148
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for YV30148: 1
2026-04-27 07:55:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: NT74531
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for NT74531: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: HD92307
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for HD92307: 1
2026-04-27 07:55:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_88c8fb5585c63e7fbb2d958c2adbf460.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: FT95535
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for FT95535: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: PU50365
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for PU50365: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: JG99232
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for JG99232: 1
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x05'
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: <table: 80 bytes>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665ad0>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_0.mpo HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_5c6dc09a61548b624cfa115844e27195.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: WR11304
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for WR11304: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: DE18860
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for DE18860: 1
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: MPFVersion (45056) - type: undefined (7) - value: b'0100'
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: NumberOfImages (45057) - type: long (4) - value: b'\x00\x00\x00\x02'
2026-04-27 07:55:34 [PIL.TiffImagePlugin] DEBUG: tag: MPEntry (45058) - type: undefined (7) Tag Location: 46 - Data Location: 50 - value: b'\x00\x03\x00\x00\x00P\x93\xd4\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x05\x86\xe5\x00PW\xf2\x00\x00\x00\x00'
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5966110>
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_4.mpo HTTP/1.1" 201 0
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_88c8fb5585c63e7fbb2d958c2adbf460.jpg saved to cache
2026-04-27 07:55:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: DB07340
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for DB07340: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: LM83836
2026-04-27 07:55:34 [auto1.it] INFO: Scrape type for LM83836: 1
2026-04-27 07:55:34 [auto1.it] INFO: Found listing with ID: FK88663
2026-04-27 07:55:35 [auto1.it] INFO: Scrape type for FK88663: 1
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH07211/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [auto1.it] INFO: Found listing with ID: VF37743
2026-04-27 07:55:35 [auto1.it] INFO: Scrape type for VF37743: 1
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN95264/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FM45145/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HR92713> (referer: https://www.auto1.com/v1/car-details-view/HR92713/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV14181> (referer: https://www.auto1.com/v1/car-details-view/SV14181/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE24006/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VA51604/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT53678/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b04a94-1a35-5d16-b131-37b482c7dbee with scrape type 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_b691d58bee1d1a73901eb65d26031c8f.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a081839e-3c46-5d24-be28-16fd2abd5cd1 with identifier: SV14181
2026-04-27 07:55:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a081839e-3c46-5d24-be28-16fd2abd5cd1 with scrape type 1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_c9fe7032c0401fddc3e688fad5da06c9.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_5775f1fbd0774ab6a0cc3ca18e2738ef.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_a6b048dacd0ff4775fdc818fc02bb878.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_1dfe9afbab60164d38fe380314d46510.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_137308f1c023c70cf19c1b885d33e942.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_d9db2df23006896ec0d65f8ebe938c02.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_adc55a505577afe08a22727dd0bbe736.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_05fd831b2c9460a4ad67f41c32d53816.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_803703b5769910e538dc0936181e882d.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_87d3a2b699819b72faf3f8b77766c7dd.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_d6cec7e5cfefc8f5cd097bbe8c78827c.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_11223980b201f29d1a6f7c3711465926.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_66198ccc434ef1f9fd211b5f1adf0913.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_f1e5570569bf0f6f8626065f3046c2a7.jpg not downloaded yet
2026-04-27 07:55:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_cd9207c32ee7b29f70dcc770422109f1.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VX22650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DE18860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_f1e5570569bf0f6f8626065f3046c2a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NB44357> (referer: https://www.auto1.com/v1/car-details-view/NB44357/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_cd9207c32ee7b29f70dcc770422109f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DB07340/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_66198ccc434ef1f9fd211b5f1adf0913.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a1590>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_f1e5570569bf0f6f8626065f3046c2a7.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bcb51c9b-ffbd-5409-a647-8a3bb283f10a with identifier: NB44357
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_984cb1ccd7502f121dd71d203bc43b66.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6384950>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_cd9207c32ee7b29f70dcc770422109f1.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_2209e7af3666dd0dd8a152842856fcde.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_d6cec7e5cfefc8f5cd097bbe8c78827c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_11223980b201f29d1a6f7c3711465926.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_836d6b13b5c93b6ce5777d4590b6feae.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568ed90>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_66198ccc434ef1f9fd211b5f1adf0913.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU45122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_618e756490539d170f011826a5934bcb.jpg not downloaded yet
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HY12574> (referer: https://www.auto1.com/v1/car-details-view/HY12574/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_70a7ab29ac861be98715c7019b8d9888.jpg not downloaded yet
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9f95387e1da4b3ace93aba385c52e54d.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_af8e52303bf6fea8bdbf883b3780b953.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_984cb1ccd7502f121dd71d203bc43b66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab3d10>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_d6cec7e5cfefc8f5cd097bbe8c78827c.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead569a290>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_11223980b201f29d1a6f7c3711465926.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_618e756490539d170f011826a5934bcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9063591c998313a2f07398bd06280760.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_87d3a2b699819b72faf3f8b77766c7dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_6bd52f39b8f37236927afd5110fac149.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5246b23e-00c9-5c8b-bacd-689b27850f99 with identifier: HY12574
2026-04-27 07:55:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5246b23e-00c9-5c8b-bacd-689b27850f99 with scrape type 1
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5b60c2aafb58d6e385916bc295868528.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_487bb5a7895abe1e84816ba3b5927e0e.jpg not downloaded yet
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_a5a223989a98e150825cf2b07a04e196.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c3050>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_984cb1ccd7502f121dd71d203bc43b66.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85cbad9465d63ff6d3af3364777536ac.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9063591c998313a2f07398bd06280760.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5886e0d26e4fdde6d9a97a8012ee8da7.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5509ad0>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_618e756490539d170f011826a5934bcb.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ad350>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_87d3a2b699819b72faf3f8b77766c7dd.jpg saved to cache
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_b37ea1e7aadf83d33232853c85d9d133.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_af8e52303bf6fea8bdbf883b3780b953.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9f95387e1da4b3ace93aba385c52e54d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85e776769a8e054c8315e50bbfa39f0f.jpg not downloaded yet
2026-04-27 07:55:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK88663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_c380b7d38b257327e777127b271319ba.jpg not downloaded yet
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5843890>
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9063591c998313a2f07398bd06280760.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_8ed3eb8573b330755fd8140bb72414f1.jpg not downloaded yet
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_a5a223989a98e150825cf2b07a04e196.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_f355dca24582e41f5ed921fcb04e5f94.jpg not downloaded yet
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_69a2820539cb971c2fcd8aef6c6ba8ae.jpg not downloaded yet
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487e90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_af8e52303bf6fea8bdbf883b3780b953.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5965910>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9f95387e1da4b3ace93aba385c52e54d.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85cbad9465d63ff6d3af3364777536ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5886e0d26e4fdde6d9a97a8012ee8da7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LZ51776/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LM83836/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4b04b50>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_a5a223989a98e150825cf2b07a04e196.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85e776769a8e054c8315e50bbfa39f0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a72c90>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85cbad9465d63ff6d3af3364777536ac.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_8ed3eb8573b330755fd8140bb72414f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_f355dca24582e41f5ed921fcb04e5f94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f8150>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5886e0d26e4fdde6d9a97a8012ee8da7.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_69a2820539cb971c2fcd8aef6c6ba8ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5934810>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85e776769a8e054c8315e50bbfa39f0f.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_487bb5a7895abe1e84816ba3b5927e0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_b37ea1e7aadf83d33232853c85d9d133.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WR11304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5b60c2aafb58d6e385916bc295868528.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c0610>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_8ed3eb8573b330755fd8140bb72414f1.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b3050>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_f355dca24582e41f5ed921fcb04e5f94.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_c380b7d38b257327e777127b271319ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_70a7ab29ac861be98715c7019b8d9888.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_6bd52f39b8f37236927afd5110fac149.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab0990>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_69a2820539cb971c2fcd8aef6c6ba8ae.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_2209e7af3666dd0dd8a152842856fcde.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e1790>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_487bb5a7895abe1e84816ba3b5927e0e.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596e250>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_b37ea1e7aadf83d33232853c85d9d133.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596d850>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5b60c2aafb58d6e385916bc295868528.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_836d6b13b5c93b6ce5777d4590b6feae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VF37743/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_803703b5769910e538dc0936181e882d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647150>
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_c380b7d38b257327e777127b271319ba.jpg saved to cache
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5246b23e-00c9-5c8b-bacd-689b27850f99
2026-04-27 07:55:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5246b23e-00c9-5c8b-bacd-689b27850f99, skipping ID generation
2026-04-27 07:55:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5246b23e-00c9-5c8b-bacd-689b27850f99 with scrape type 1
2026-04-27 07:55:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5246b23e-00c9-5c8b-bacd-689b27850f99 sending to next pipeline
2026-04-27 07:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5246b23e-00c9-5c8b-bacd-689b27850f99, identifier: HY12574
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a02010>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_70a7ab29ac861be98715c7019b8d9888.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596f410>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_6bd52f39b8f37236927afd5110fac149.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4ddbc10>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_2209e7af3666dd0dd8a152842856fcde.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5246b23e-00c9-5c8b-bacd-689b27850f99 with identifier: HY12574
2026-04-27 07:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5246b23e-00c9-5c8b-bacd-689b27850f99 with identifier: HY12574
2026-04-27 07:55:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5246b23e-00c9-5c8b-bacd-689b27850f99 with identifier: HY12574 to the API
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_c380b7d38b257327e777127b271319ba.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:26:33Z',
'fuel_type': 'petrol',
'id': '5246b23e-00c9-5c8b-bacd-689b27850f99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY12574',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 59983,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5b60c2aafb58d6e385916bc295868528.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69367,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_a5a223989a98e150825cf2b07a04e196.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67676,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85cbad9465d63ff6d3af3364777536ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58404,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_5886e0d26e4fdde6d9a97a8012ee8da7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_b37ea1e7aadf83d33232853c85d9d133.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_85e776769a8e054c8315e50bbfa39f0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_c380b7d38b257327e777127b271319ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_8ed3eb8573b330755fd8140bb72414f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_f355dca24582e41f5ed921fcb04e5f94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5246b23e-00c9-5c8b-bacd-689b27850f99/5246b23e-00c9-5c8b-bacd-689b27850f99_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/83/b3835739cc66affb32c5eb7aefd6deeb/pa/HY12574_69a2820539cb971c2fcd8aef6c6ba8ae.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2020-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2020}
2026-04-27 07:55:38 [auto1.it] INFO: Saving data for HY12574: {'created_time': 1777276538.603834, 'last_price_update_time': 1777276538.603845, 'has_photos': True, 'auction_closing_time': 1777389993.0}
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_05fd831b2c9460a4ad67f41c32d53816.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JG99232/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PU50365/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD92307/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FT95535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63fa610>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_836d6b13b5c93b6ce5777d4590b6feae.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a
2026-04-27 07:55:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bcb51c9b-ffbd-5409-a647-8a3bb283f10a, skipping ID generation
2026-04-27 07:55:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a with scrape type 1
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bcb51c9b-ffbd-5409-a647-8a3bb283f10a sending to next pipeline
2026-04-27 07:55:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bcb51c9b-ffbd-5409-a647-8a3bb283f10a, identifier: NB44357
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0cdd0>
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_803703b5769910e538dc0936181e882d.jpg saved to cache
2026-04-27 07:55:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_adc55a505577afe08a22727dd0bbe736.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VX22650> (referer: https://www.auto1.com/v1/car-details-view/VX22650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bcb51c9b-ffbd-5409-a647-8a3bb283f10a with identifier: NB44357
2026-04-27 07:55:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bcb51c9b-ffbd-5409-a647-8a3bb283f10a with identifier: NB44357
2026-04-27 07:55:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bcb51c9b-ffbd-5409-a647-8a3bb283f10a with identifier: NB44357 to the API
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_836d6b13b5c93b6ce5777d4590b6feae.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:21:11Z',
'fuel_type': 'diesel',
'id': 'bcb51c9b-ffbd-5409-a647-8a3bb283f10a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NB44357',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Volvo',
'model': 'XC60',
'odometer': 371564,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_984cb1ccd7502f121dd71d203bc43b66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_2209e7af3666dd0dd8a152842856fcde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_836d6b13b5c93b6ce5777d4590b6feae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53075,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_618e756490539d170f011826a5934bcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61206,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_70a7ab29ac861be98715c7019b8d9888.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9f95387e1da4b3ace93aba385c52e54d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_af8e52303bf6fea8bdbf883b3780b953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_9063591c998313a2f07398bd06280760.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_6bd52f39b8f37236927afd5110fac149.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bcb51c9b-ffbd-5409-a647-8a3bb283f10a/bcb51c9b-ffbd-5409-a647-8a3bb283f10a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/41/a3413e85d895706413b4dd010255bce5/pa/NB44357_487bb5a7895abe1e84816ba3b5927e0e.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2013-08-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2013}
2026-04-27 07:55:39 [auto1.it] INFO: Saving data for NB44357: {'created_time': 1777276539.394732, 'last_price_update_time': 1777276539.394743, 'has_photos': True, 'auction_closing_time': 1777389671.0}
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DE18860> (referer: https://www.auto1.com/v1/car-details-view/DE18860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5919050>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_05fd831b2c9460a4ad67f41c32d53816.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f2c10>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_adc55a505577afe08a22727dd0bbe736.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae4f036-f299-5d3a-a479-901ddcf16085 with identifier: VX22650
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae4f036-f299-5d3a-a479-901ddcf16085 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_808d35689dc6466453ef99af569d4da0.jpg not downloaded yet
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_d9db2df23006896ec0d65f8ebe938c02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_137308f1c023c70cf19c1b885d33e942.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_a6b048dacd0ff4775fdc818fc02bb878.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_5775f1fbd0774ab6a0cc3ca18e2738ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_1dfe9afbab60164d38fe380314d46510.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_6596730f588da8b70605c9599c15bcdb.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-04-27 07:55:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 1
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_29fed363b02d4d46ea5b86c6c85d1240.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_c2eb4c2326865be21e4519f6b84ac560.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg not downloaded yet
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_9258bfe2ccb8ae6c6dcc22576fb59c41.jpg not downloaded yet
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a489d0>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_d9db2df23006896ec0d65f8ebe938c02.jpg saved to cache
2026-04-27 07:55:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551ea50>
2026-04-27 07:55:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_137308f1c023c70cf19c1b885d33e942.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_808d35689dc6466453ef99af569d4da0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64ad6d0>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_a6b048dacd0ff4775fdc818fc02bb878.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead591b090>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_5775f1fbd0774ab6a0cc3ca18e2738ef.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f5050>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_1dfe9afbab60164d38fe380314d46510.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645df90>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_808d35689dc6466453ef99af569d4da0.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN40589/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_9258bfe2ccb8ae6c6dcc22576fb59c41.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DB07340> (referer: https://www.auto1.com/v1/car-details-view/DB07340/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d9a10>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_9258bfe2ccb8ae6c6dcc22576fb59c41.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_c2eb4c2326865be21e4519f6b84ac560.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82274f43-50f3-585b-92ed-f1eef95a51b2 with identifier: DB07340
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82274f43-50f3-585b-92ed-f1eef95a51b2 with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a49bd7098e76fed1bcf3b62be1db2f6d.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_0641819048c21e189c69b823564ada5a.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_09800fce9f9880fc6871261db68b2a2d.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_b905ba5ccb42c9eebd4ab8e68b88e1cd.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e1650>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a14c476e92dda3c694582240cc2029ff.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK88663> (referer: https://www.auto1.com/v1/car-details-view/FK88663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_20a787a61b769d400672cf504cefc849.jpg not downloaded yet
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a48e90>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587b910>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_c2eb4c2326865be21e4519f6b84ac560.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_31abe9e0d6a66689751f7fab642dfc0d.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_b905ba5ccb42c9eebd4ab8e68b88e1cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LM83836> (referer: https://www.auto1.com/v1/car-details-view/LM83836/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_ba785cfc76c3d3f67fe416a01639aa1e.jpg not downloaded yet
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ51776> (referer: https://www.auto1.com/v1/car-details-view/LZ51776/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU45122> (referer: https://www.auto1.com/v1/car-details-view/RU45122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56b2350>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_9a4fb3eaecfa4bd2f828577ca371fe88.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51a608a2-ad8b-5bc2-bae4-059b3a69603e with identifier: FK88663
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f4365e887ae9ca1db461620b317cfabe.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f4950>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a14c476e92dda3c694582240cc2029ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_09800fce9f9880fc6871261db68b2a2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_45138b9d5da9728fb77062f65f617275.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_9821ea8c59caa09a83d2ec70541759c1.jpg not downloaded yet
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29650>
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_b905ba5ccb42c9eebd4ab8e68b88e1cd.jpg saved to cache
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b679c3-3ed4-57c2-9181-c1a8afcafeba with identifier: LM83836
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_d26943cc515e05e213774d5182b1bb26.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed912126-84e7-5f42-9eb7-b3afb033dfe7 with identifier: LZ51776
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed912126-84e7-5f42-9eb7-b3afb033dfe7 with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_80c00a229e31211a1367b3746191d05b.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a19a821b-fe43-59ff-9a31-191e4b811db1 with identifier: RU45122
2026-04-27 07:55:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19a821b-fe43-59ff-9a31-191e4b811db1 with scrape type 1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_6cc370cbf2cf352394e1a46607d9eb17.jpg not downloaded yet
2026-04-27 07:55:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_ff1dd9772f4414fb38ede5edb7fbe2b4.jpg not downloaded yet
2026-04-27 07:55:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_0641819048c21e189c69b823564ada5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_e5b64dd712b0f56a694925a1821d4437.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_649023f3d0913bad5250a0d385ded642.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_46b81f6bdf5badfffc3ce8f17d3915b0.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a49bd7098e76fed1bcf3b62be1db2f6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_31abe9e0d6a66689751f7fab642dfc0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_20a787a61b769d400672cf504cefc849.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_fbe6c8167c2b8ecc631acd666d234ff2.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f4365e887ae9ca1db461620b317cfabe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_31aa8c40ddffd09e719eafa03e4b81e5.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e3deb5fedd4720ad022df85e7cbd56fc.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_ede480efa21f0a9deee549e5e600ed8b.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5751710>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a14c476e92dda3c694582240cc2029ff.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5882190>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_09800fce9f9880fc6871261db68b2a2d.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_ba785cfc76c3d3f67fe416a01639aa1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_8ee1631b6fbd81610ffc78420d2806fd.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_34ab6fa8c410be506d29eb5381558b94.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_7cfd70d9e5311b057d0dea9152762ced.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_504cf69e04472109bacf9bf6b5c5be15.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_6cc370cbf2cf352394e1a46607d9eb17.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f8d43077952ff8c34966bc209ec94b35.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659c450>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_0641819048c21e189c69b823564ada5a.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55da5d0>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a49bd7098e76fed1bcf3b62be1db2f6d.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a89290>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_31abe9e0d6a66689751f7fab642dfc0d.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5946890>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_20a787a61b769d400672cf504cefc849.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a89e10>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f4365e887ae9ca1db461620b317cfabe.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_80c00a229e31211a1367b3746191d05b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_46b81f6bdf5badfffc3ce8f17d3915b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_72dd87a6c3a6e11d280f7b8d15bbb4fd.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_256fa77abc68b749bc545c9c533074b4.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_f0b0a42678a6dac4f07c970ce5b030ab.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_ff1dd9772f4414fb38ede5edb7fbe2b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_fbe6c8167c2b8ecc631acd666d234ff2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_d26943cc515e05e213774d5182b1bb26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_4237b25c7da28ff1c723215afccdbc7e.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_bed4587f7b2b72250d789ae779a49b30.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_900f319cdf661f02cc8bd34e7c092221.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VA51604> (referer: https://www.auto1.com/v1/car-details-view/VA51604/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5988a50>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_ba785cfc76c3d3f67fe416a01639aa1e.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5887f10>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_6cc370cbf2cf352394e1a46607d9eb17.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_89c6ebf007e0ea9394faae9035344159.jpg not downloaded yet
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_504cf69e04472109bacf9bf6b5c5be15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_7cfd70d9e5311b057d0dea9152762ced.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_8ee1631b6fbd81610ffc78420d2806fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_f394ff1369805154448df28c63b77153.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_66b293534395e59e48cb7ddde37929cb.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_6b5417b1704aa758c62b8b783202c832.jpg not downloaded yet
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT53678> (referer: https://www.auto1.com/v1/car-details-view/LT53678/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f8d43077952ff8c34966bc209ec94b35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_a436476afd65beb7d34748e9b83d08c5.jpg not downloaded yet
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_3f1a92520933a417cb17bc6677d276c8.jpg not downloaded yet
2026-04-27 07:55:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_ede480efa21f0a9deee549e5e600ed8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_34ab6fa8c410be506d29eb5381558b94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_0f88258be506467712870ddd27877013.jpg not downloaded yet
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55534d0>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_80c00a229e31211a1367b3746191d05b.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5596910>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_46b81f6bdf5badfffc3ce8f17d3915b0.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953210>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_ff1dd9772f4414fb38ede5edb7fbe2b4.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5596f10>
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_fbe6c8167c2b8ecc631acd666d234ff2.jpg saved to cache
2026-04-27 07:55:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead588a3d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_d26943cc515e05e213774d5182b1bb26.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89907b32-3750-52c1-8e9e-bebcef664ef8 with identifier: VA51604
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89907b32-3750-52c1-8e9e-bebcef664ef8 with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_d2a1fde33f7b5d861a0aa1f7ab99735f.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_900f319cdf661f02cc8bd34e7c092221.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_f0b0a42678a6dac4f07c970ce5b030ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_15d93e3572ad30273cc95e854416ce8a.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_304a064bc7df63d9d0c20f0252815c92.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_bed4587f7b2b72250d789ae779a49b30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_4237b25c7da28ff1c723215afccdbc7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_837df870f6e744446ea7b986c934444e.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VF37743> (referer: https://www.auto1.com/v1/car-details-view/VF37743/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e36d8143d8cdf0756f19baeaef88ac66.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_795cf4ca688fc12c39d4dffd45e466cf.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FT95535> (referer: https://www.auto1.com/v1/car-details-view/FT95535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD92307> (referer: https://www.auto1.com/v1/car-details-view/HD92307/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5596390>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_504cf69e04472109bacf9bf6b5c5be15.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581d110>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_7cfd70d9e5311b057d0dea9152762ced.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5f10>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_8ee1631b6fbd81610ffc78420d2806fd.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc50140a-8a38-53c2-a782-24480f99b83c with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_c4af13a72149e7a78ee429ba342ada43.jpg not downloaded yet
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b4d90>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f8d43077952ff8c34966bc209ec94b35.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b7710>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_ede480efa21f0a9deee549e5e600ed8b.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8690>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_34ab6fa8c410be506d29eb5381558b94.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_07543780012f2af98fbb8c79f9a05c90.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PU50365> (referer: https://www.auto1.com/v1/car-details-view/PU50365/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_89c6ebf007e0ea9394faae9035344159.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_6b5417b1704aa758c62b8b783202c832.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_3f1a92520933a417cb17bc6677d276c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_a436476afd65beb7d34748e9b83d08c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_66b293534395e59e48cb7ddde37929cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_f394ff1369805154448df28c63b77153.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f4c293d5c2301d121c8c58801351aec3.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_03f6a6f7f533d2213548e617b4c8703a.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_d2a1fde33f7b5d861a0aa1f7ab99735f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_e1e8e034a7ca17c3e42705d98bcfa88c.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WR11304> (referer: https://www.auto1.com/v1/car-details-view/WR11304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_304a064bc7df63d9d0c20f0252815c92.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_0f88258be506467712870ddd27877013.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_ed1ff6afa6b24dd7ede060e1a773f8a6.jpg not downloaded yet
2026-04-27 07:55:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JG99232> (referer: https://www.auto1.com/v1/car-details-view/JG99232/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56dd6d0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_900f319cdf661f02cc8bd34e7c092221.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a96210>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_f0b0a42678a6dac4f07c970ce5b030ab.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4abe310>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_bed4587f7b2b72250d789ae779a49b30.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4abefd0>
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_4237b25c7da28ff1c723215afccdbc7e.jpg saved to cache
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb144039-eb53-5eb7-9c40-3d4822c16b54 with identifier: VF37743
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb144039-eb53-5eb7-9c40-3d4822c16b54 with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_fce6a305251e8145070ba2dd1c0d9db7.jpg not downloaded yet
2026-04-27 07:55:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ca77cbc-1748-581a-961b-764a6fdc260e with identifier: FT95535
2026-04-27 07:55:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca77cbc-1748-581a-961b-764a6fdc260e with scrape type 1
2026-04-27 07:55:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1ae674150f46eec5c3e7a7a0d3553464.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3065d8fc-4043-50fa-a500-2465ce18c416 with identifier: HD92307
2026-04-27 07:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3065d8fc-4043-50fa-a500-2465ce18c416 with scrape type 1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b8da99ccc9cbf5896db9f7bfb1b58dcd.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_d451151d0aa6781e87c58fb37e9592bb.jpg not downloaded yet
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_15d93e3572ad30273cc95e854416ce8a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e36d8143d8cdf0756f19baeaef88ac66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_b7fab3312b56d8ecadbff408abc80e20.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_4d02bc273fc0d349118f916afe83d7b3.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_110d144d07c91325907d0db6d6e45aa9.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_326b60ed12a159da973943a8e1956ed1.jpg not downloaded yet
2026-04-27 07:55:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-04-27 07:55:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3fb07a0-edde-5c01-a450-db3ac03ce89e with scrape type 1
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg not downloaded yet
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6590890>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_89c6ebf007e0ea9394faae9035344159.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5556390>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_6b5417b1704aa758c62b8b783202c832.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5668bd0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_3f1a92520933a417cb17bc6677d276c8.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64765d0>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_a436476afd65beb7d34748e9b83d08c5.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63faa10>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_66b293534395e59e48cb7ddde37929cb.jpg saved to cache
2026-04-27 07:55:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5586990>
2026-04-27 07:55:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_f394ff1369805154448df28c63b77153.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_c4af13a72149e7a78ee429ba342ada43.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_795cf4ca688fc12c39d4dffd45e466cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_837df870f6e744446ea7b986c934444e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_be2fc461b4a2480941d853dfde0c106c.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_72dd87a6c3a6e11d280f7b8d15bbb4fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e3deb5fedd4720ad022df85e7cbd56fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_256fa77abc68b749bc545c9c533074b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_7f75aac28c9a2f6c44cf9eb464923c87.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_a49a4032e76b8eb7b8d194b66caab507.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_b5145d496619fbfe415c1712a71c3452.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_deb5b0450a9d954279b9547342d085f6.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b11c2d9e23d13bd34dcc096108993972.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE24006> (referer: https://www.auto1.com/v1/car-details-view/SE24006/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN40589> (referer: https://www.auto1.com/v1/car-details-view/GN40589/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c1c10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_d2a1fde33f7b5d861a0aa1f7ab99735f.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58baad0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_304a064bc7df63d9d0c20f0252815c92.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c8d10>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_0f88258be506467712870ddd27877013.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a8139b-869f-5d28-8e30-7a08b935e2bf with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5624a90>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_15d93e3572ad30273cc95e854416ce8a.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589d7d0>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e36d8143d8cdf0756f19baeaef88ac66.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_649023f3d0913bad5250a0d385ded642.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_03f6a6f7f533d2213548e617b4c8703a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_31aa8c40ddffd09e719eafa03e4b81e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_70aa86299da4457dcecfc163c318760f.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_14cf1ca00ec900bc79e1f357b05d7747.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8a969564cfad3b552ca72c9ca41257de.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ea2226aa10b0607bfc2a45aed550f1c7.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f73745d60762a51cf3f019a99574276e.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg not downloaded yet
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_fce6a305251e8145070ba2dd1c0d9db7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_07543780012f2af98fbb8c79f9a05c90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f4c293d5c2301d121c8c58801351aec3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_108f856285cdfe1845d2539fa96d9170.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_1342f7080a0a2fcf126ac98410e47d74.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8eb5a631d5da14390633c0746fdf4ff5.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b44e7f865a784ed5408ba0084bc2e957.jpg not downloaded yet
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg not downloaded yet
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c6390>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_c4af13a72149e7a78ee429ba342ada43.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6482110>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_795cf4ca688fc12c39d4dffd45e466cf.jpg saved to cache
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a19a821b-fe43-59ff-9a31-191e4b811db1
2026-04-27 07:55:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a19a821b-fe43-59ff-9a31-191e4b811db1, skipping ID generation
2026-04-27 07:55:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a19a821b-fe43-59ff-9a31-191e4b811db1 with scrape type 1
2026-04-27 07:55:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a19a821b-fe43-59ff-9a31-191e4b811db1 sending to next pipeline
2026-04-27 07:55:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a19a821b-fe43-59ff-9a31-191e4b811db1, identifier: RU45122
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59a6450>
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_837df870f6e744446ea7b986c934444e.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6312410>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_72dd87a6c3a6e11d280f7b8d15bbb4fd.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a36dd0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e3deb5fedd4720ad022df85e7cbd56fc.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64838d0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_256fa77abc68b749bc545c9c533074b4.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c365706a-11de-5dde-b587-af07c599377b with identifier: SE24006
2026-04-27 07:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c365706a-11de-5dde-b587-af07c599377b with scrape type 1
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0f38d82f41454d8d21d9b851de8a3ab6.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-04-27 07:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aef7be-2a29-5499-8024-4f798af47124 with scrape type 1
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg not downloaded yet
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_d451151d0aa6781e87c58fb37e9592bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1ae674150f46eec5c3e7a7a0d3553464.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b8da99ccc9cbf5896db9f7bfb1b58dcd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_8d9ba1e05b9f1c5d44ea5c6078664ba2.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a19a821b-fe43-59ff-9a31-191e4b811db1 with identifier: RU45122
2026-04-27 07:55:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a19a821b-fe43-59ff-9a31-191e4b811db1 with identifier: RU45122
2026-04-27 07:55:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a19a821b-fe43-59ff-9a31-191e4b811db1 with identifier: RU45122 to the API
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_795cf4ca688fc12c39d4dffd45e466cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:34:30Z',
'fuel_type': 'diesel',
'id': 'a19a821b-fe43-59ff-9a31-191e4b811db1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU45122',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 196738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_6cc370cbf2cf352394e1a46607d9eb17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_46b81f6bdf5badfffc3ce8f17d3915b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_ede480efa21f0a9deee549e5e600ed8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_504cf69e04472109bacf9bf6b5c5be15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_f0b0a42678a6dac4f07c970ce5b030ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_900f319cdf661f02cc8bd34e7c092221.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_66b293534395e59e48cb7ddde37929cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_3f1a92520933a417cb17bc6677d276c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_304a064bc7df63d9d0c20f0252815c92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a19a821b-fe43-59ff-9a31-191e4b811db1/a19a821b-fe43-59ff-9a31-191e4b811db1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga3/77/a377bbfc3258500040b3eb2defad5109/pa/RU45122_795cf4ca688fc12c39d4dffd45e466cf.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.6 TDI Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2014}
2026-04-27 07:55:45 [auto1.it] INFO: Saving data for RU45122: {'created_time': 1777276545.593982, 'last_price_update_time': 1777276545.593996, 'has_photos': True, 'auction_closing_time': 1777390470.0}
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_874bdd76272eb47a9b40108168306329.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_0f6ec06b929b5ab317bbc2e7635736f4.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_54057648d96ed0452051711145c72c26.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_2cb9d3a571e3e242b98d3467173cfcf5.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5749fea00264c60346c72639f855eac9.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg not downloaded yet
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ca710>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_649023f3d0913bad5250a0d385ded642.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed912126-84e7-5f42-9eb7-b3afb033dfe7
2026-04-27 07:55:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed912126-84e7-5f42-9eb7-b3afb033dfe7, skipping ID generation
2026-04-27 07:55:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed912126-84e7-5f42-9eb7-b3afb033dfe7 with scrape type 1
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed912126-84e7-5f42-9eb7-b3afb033dfe7 sending to next pipeline
2026-04-27 07:55:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed912126-84e7-5f42-9eb7-b3afb033dfe7, identifier: LZ51776
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5988810>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_03f6a6f7f533d2213548e617b4c8703a.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f36d0>
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_31aa8c40ddffd09e719eafa03e4b81e5.jpg saved to cache
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_ed1ff6afa6b24dd7ede060e1a773f8a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_e1e8e034a7ca17c3e42705d98bcfa88c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b9aa73b3acc18568243090c1157d5506.jpg not downloaded yet
2026-04-27 07:55:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed912126-84e7-5f42-9eb7-b3afb033dfe7 with identifier: LZ51776
2026-04-27 07:55:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed912126-84e7-5f42-9eb7-b3afb033dfe7 with identifier: LZ51776
2026-04-27 07:55:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed912126-84e7-5f42-9eb7-b3afb033dfe7 with identifier: LZ51776 to the API
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_649023f3d0913bad5250a0d385ded642.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:37:43Z',
'fuel_type': 'diesel',
'id': 'ed912126-84e7-5f42-9eb7-b3afb033dfe7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ51776',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Audi',
'model': 'Q5',
'odometer': 169401,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_80c00a229e31211a1367b3746191d05b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_649023f3d0913bad5250a0d385ded642.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e3deb5fedd4720ad022df85e7cbd56fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_7cfd70d9e5311b057d0dea9152762ced.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_256fa77abc68b749bc545c9c533074b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_bed4587f7b2b72250d789ae779a49b30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_f394ff1369805154448df28c63b77153.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_a436476afd65beb7d34748e9b83d08c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59551,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_15d93e3572ad30273cc95e854416ce8a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed912126-84e7-5f42-9eb7-b3afb033dfe7/ed912126-84e7-5f42-9eb7-b3afb033dfe7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/1e/001e099bd80a22c0e956e4bb2f04b2cc/pa/LZ51776_e36d8143d8cdf0756f19baeaef88ac66.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2013-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q5 2.0 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2013}
2026-04-27 07:55:46 [auto1.it] INFO: Saving data for LZ51776: {'created_time': 1777276546.421321, 'last_price_update_time': 1777276546.421336, 'has_photos': True, 'auction_closing_time': 1777390663.0}
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594cd50>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_fce6a305251e8145070ba2dd1c0d9db7.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5343510>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_07543780012f2af98fbb8c79f9a05c90.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead534ef50>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f4c293d5c2301d121c8c58801351aec3.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_b5145d496619fbfe415c1712a71c3452.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_326b60ed12a159da973943a8e1956ed1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_be2fc461b4a2480941d853dfde0c106c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_7ca7c166ee5a8845008cac2a3c6436d0.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_02e0b65bfdc4e6beec5c2e7e55570e87.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ff6109f2f7b90843d7e3949939da6725.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_68f0c245e462d7f040e94f43ba2cabff.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg not downloaded yet
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_deb5b0450a9d954279b9547342d085f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_65f631912bcd5c916952fc7605da1bd6.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg not downloaded yet
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg not downloaded yet
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64bb190>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_d451151d0aa6781e87c58fb37e9592bb.jpg saved to cache
2026-04-27 07:55:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57cff50>
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1ae674150f46eec5c3e7a7a0d3553464.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568f510>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b8da99ccc9cbf5896db9f7bfb1b58dcd.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_e02c45417982062f204f4663a6a2b7b9.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1e612bd93ad26c126daa01fc90bc7b27.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_17393fe04ce03cc8aa10ef0668a859a2.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0029a390b18ca7888296482420ef69ac.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg not downloaded yet
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_a49a4032e76b8eb7b8d194b66caab507.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_7f75aac28c9a2f6c44cf9eb464923c87.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg not downloaded yet
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ec50>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_ed1ff6afa6b24dd7ede060e1a773f8a6.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58187d0>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_e1e8e034a7ca17c3e42705d98bcfa88c.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead543fe50>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_b5145d496619fbfe415c1712a71c3452.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6311d50>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead592ea10>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_326b60ed12a159da973943a8e1956ed1.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581b410>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_be2fc461b4a2480941d853dfde0c106c.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_aa9101657c94200fa586385b5948bcee.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_d4828feb38dbda9b3065e50dc91ce8d3.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_21ec8f5839c492e6b212b58ec1ac60c3.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5950b35ffe1c6c140d5a84d488bc90c3.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg not downloaded yet
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a8b790>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589d610>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_deb5b0450a9d954279b9547342d085f6.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f73745d60762a51cf3f019a99574276e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ea2226aa10b0607bfc2a45aed550f1c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8a969564cfad3b552ca72c9ca41257de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg not downloaded yet
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_6c85c0e1021adeda7148f274d0cdeea8.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_e9efc9a5d5314b883ce87e940204f530.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_84c0ceae13ca4e03afc4ebd712b69fa2.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_8f282521458a7761b8a51fd0e30dfa97.jpg not downloaded yet
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg not downloaded yet
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560fb90>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_a49a4032e76b8eb7b8d194b66caab507.jpg saved to cache
2026-04-27 07:55:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58da710>
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_7f75aac28c9a2f6c44cf9eb464923c87.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_372d03b89aad729fb412fa0443e17bc8.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg not downloaded yet
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6481a50>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f73745d60762a51cf3f019a99574276e.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568c490>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ea2226aa10b0607bfc2a45aed550f1c7.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586e390>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8a969564cfad3b552ca72c9ca41257de.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ae150>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4abe990>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65d82d0>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab9590>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5749fea00264c60346c72639f855eac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_b6d4354abe976e9a30b2cb368b1a6958.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg not downloaded yet
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5325c50>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b9aa73b3acc18568243090c1157d5506.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_1d6afdb7f08f7fb52692927771638008.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg not downloaded yet
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5950b35ffe1c6c140d5a84d488bc90c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_ab4415a9976132e75bb908a79d31d28b.jpg not downloaded yet
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg not downloaded yet
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545e710>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64bba10>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5749fea00264c60346c72639f855eac9.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c7290>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54bb810>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_21ec8f5839c492e6b212b58ec1ac60c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_aa9101657c94200fa586385b5948bcee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_372d03b89aad729fb412fa0443e17bc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566ff90>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cda90>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56b3b50>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg saved to cache
2026-04-27 07:55:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_d4828feb38dbda9b3065e50dc91ce8d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943350>
2026-04-27 07:55:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b9aa73b3acc18568243090c1157d5506.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead532e790>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6395150>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5950b35ffe1c6c140d5a84d488bc90c3.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54a3a50>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d7150>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56478d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56efa50>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_21ec8f5839c492e6b212b58ec1ac60c3.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d6f90>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_aa9101657c94200fa586385b5948bcee.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b02d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54aebd0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_372d03b89aad729fb412fa0443e17bc8.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64acfd0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_d4828feb38dbda9b3065e50dc91ce8d3.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63a8750>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_1d6afdb7f08f7fb52692927771638008.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571a450>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_b6d4354abe976e9a30b2cb368b1a6958.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_8f282521458a7761b8a51fd0e30dfa97.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_ab4415a9976132e75bb908a79d31d28b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_e9efc9a5d5314b883ce87e940204f530.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae650ddd0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f72d0>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6569910>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5718d50>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg saved to cache
2026-04-27 07:55:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589b350>
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5871d50>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_84c0ceae13ca4e03afc4ebd712b69fa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_6c85c0e1021adeda7148f274d0cdeea8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c35d0>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5337bd0>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55137d0>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_1d6afdb7f08f7fb52692927771638008.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65ac490>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_b6d4354abe976e9a30b2cb368b1a6958.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8450>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a24b50>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_8f282521458a7761b8a51fd0e30dfa97.jpg saved to cache
2026-04-27 07:55:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58724d0>
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_ab4415a9976132e75bb908a79d31d28b.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513c90>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_e9efc9a5d5314b883ce87e940204f530.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead532c650>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5511390>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_84c0ceae13ca4e03afc4ebd712b69fa2.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63ab490>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_6c85c0e1021adeda7148f274d0cdeea8.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8d90>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0029a390b18ca7888296482420ef69ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_e02c45417982062f204f4663a6a2b7b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_17393fe04ce03cc8aa10ef0668a859a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1e612bd93ad26c126daa01fc90bc7b27.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_65f631912bcd5c916952fc7605da1bd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57693d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580fcd0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57badd0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_68f0c245e462d7f040e94f43ba2cabff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_2cb9d3a571e3e242b98d3467173cfcf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580dd90>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0029a390b18ca7888296482420ef69ac.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58715d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_e02c45417982062f204f4663a6a2b7b9.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ee4d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_17393fe04ce03cc8aa10ef0668a859a2.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5834d50>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1e612bd93ad26c126daa01fc90bc7b27.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927dd0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_65f631912bcd5c916952fc7605da1bd6.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_02e0b65bfdc4e6beec5c2e7e55570e87.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ff6109f2f7b90843d7e3949939da6725.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_7ca7c166ee5a8845008cac2a3c6436d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_54057648d96ed0452051711145c72c26.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_0f6ec06b929b5ab317bbc2e7635736f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_874bdd76272eb47a9b40108168306329.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5512b10>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_68f0c245e462d7f040e94f43ba2cabff.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d99d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5709b90>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_2cb9d3a571e3e242b98d3467173cfcf5.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0f38d82f41454d8d21d9b851de8a3ab6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d8590>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_02e0b65bfdc4e6beec5c2e7e55570e87.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55403d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ff6109f2f7b90843d7e3949939da6725.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549dd90>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_7ca7c166ee5a8845008cac2a3c6436d0.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54a2fd0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_54057648d96ed0452051711145c72c26.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65ad8d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_0f6ec06b929b5ab317bbc2e7635736f4.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581e190>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_874bdd76272eb47a9b40108168306329.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54937d0>
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg saved to cache
2026-04-27 07:55:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8eb5a631d5da14390633c0746fdf4ff5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_1342f7080a0a2fcf126ac98410e47d74.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_14cf1ca00ec900bc79e1f357b05d7747.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_8d9ba1e05b9f1c5d44ea5c6078664ba2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b44e7f865a784ed5408ba0084bc2e957.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_108f856285cdfe1845d2539fa96d9170.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_70aa86299da4457dcecfc163c318760f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545e490>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0f38d82f41454d8d21d9b851de8a3ab6.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c365706a-11de-5dde-b587-af07c599377b
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c365706a-11de-5dde-b587-af07c599377b, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c365706a-11de-5dde-b587-af07c599377b with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c365706a-11de-5dde-b587-af07c599377b sending to next pipeline
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c365706a-11de-5dde-b587-af07c599377b, identifier: SE24006
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a2750>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57aef7be-2a29-5499-8024-4f798af47124
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57aef7be-2a29-5499-8024-4f798af47124, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57aef7be-2a29-5499-8024-4f798af47124 with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57aef7be-2a29-5499-8024-4f798af47124 sending to next pipeline
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 57aef7be-2a29-5499-8024-4f798af47124, identifier: GN40589
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3e50>
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg saved to cache
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e3fb07a0-edde-5c01-a450-db3ac03ce89e
2026-04-27 07:55:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e3fb07a0-edde-5c01-a450-db3ac03ce89e, skipping ID generation
2026-04-27 07:55:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e3fb07a0-edde-5c01-a450-db3ac03ce89e with scrape type 1
2026-04-27 07:55:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e3fb07a0-edde-5c01-a450-db3ac03ce89e sending to next pipeline
2026-04-27 07:55:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e3fb07a0-edde-5c01-a450-db3ac03ce89e, identifier: PU50365
2026-04-27 07:55:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c365706a-11de-5dde-b587-af07c599377b with identifier: SE24006
2026-04-27 07:55:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c365706a-11de-5dde-b587-af07c599377b with identifier: SE24006
2026-04-27 07:55:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c365706a-11de-5dde-b587-af07c599377b with identifier: SE24006 to the API
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0f38d82f41454d8d21d9b851de8a3ab6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'city': 'Reggio Emilia',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:50:52Z',
'fuel_type': 'diesel',
'id': 'c365706a-11de-5dde-b587-af07c599377b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE24006',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Peugeot',
'model': '2008',
'odometer': 154814,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0f38d82f41454d8d21d9b851de8a3ab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5749fea00264c60346c72639f855eac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_68f0c245e462d7f040e94f43ba2cabff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_0029a390b18ca7888296482420ef69ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_5950b35ffe1c6c140d5a84d488bc90c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_8f282521458a7761b8a51fd0e30dfa97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_372d03b89aad729fb412fa0443e17bc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_b6d4354abe976e9a30b2cb368b1a6958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_1d6afdb7f08f7fb52692927771638008.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c365706a-11de-5dde-b587-af07c599377b/c365706a-11de-5dde-b587-af07c599377b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgee/d2/eed28fbf923ef4c9df7dd8f80d9e0722/pa/SE24006_ab4415a9976132e75bb908a79d31d28b.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2016-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2016}
2026-04-27 07:55:53 [auto1.it] INFO: Saving data for SE24006: {'created_time': 1777276553.074901, 'last_price_update_time': 1777276553.074914, 'has_photos': True, 'auction_closing_time': 1777391452.0}
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589
2026-04-27 07:55:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 57aef7be-2a29-5499-8024-4f798af47124 with identifier: GN40589 to the API
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:53:43Z',
'fuel_type': 'diesel',
'id': '57aef7be-2a29-5499-8024-4f798af47124',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN40589',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 271343,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_af9950d8d718d6d43cc688df001f88b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c8f288647eefd570d5496191108c5c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_369daff5904680da45b7cec6d0ae0d88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_78225655c7d28e52474ce7c6b5b70698.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_07cde87017c78cef7146aca89b383f6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_3bc17cfcf72f78a8358b99592e4c0af6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_132cf39f33231bbd371c010857f7ab59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_8dcb3ff31f8fb7c69654ca9ab2633ef5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_c82de676e7d6f570c85e86bfcbf8b1b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_57aef7be-2a29-5499-8024-4f798af47124/57aef7be-2a29-5499-8024-4f798af47124_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ab/a7ab174553ceae4d07d7a194175a8164/pa/GN40589_1c9ce5b116bdfce55dd100640b4ba488.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2019-05-15',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 1.6 TDI Sport BlueMotion Tech',
'transmission': 'manual',
'trim': 'Sport BlueMotion Tech',
'year': 2019}
2026-04-27 07:55:53 [auto1.it] INFO: Saving data for GN40589: {'created_time': 1777276553.487275, 'last_price_update_time': 1777276553.487285, 'has_photos': True, 'auction_closing_time': 1777391623.0}
2026-04-27 07:55:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-04-27 07:55:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365
2026-04-27 07:55:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e3fb07a0-edde-5c01-a450-db3ac03ce89e with identifier: PU50365 to the API
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:07:35Z',
'fuel_type': 'diesel',
'id': 'e3fb07a0-edde-5c01-a450-db3ac03ce89e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU50365',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Audi',
'model': 'A4',
'odometer': 205518,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_1570b13f87ea1dfe99381ad4dff12cb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_a9f06e5a72fc891de0ffbb16d8f9b002.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_07f3cd797fb0a00b57bc952c3550e6d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_16ec0ddcb0700d9871e7d2abf1c22188.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_5a686a555ed0b45fafacf67b0d50404b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_064108874f83510ba6ba3db6516bcfbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_7de8a34a644d46c7195cb9c05207c6a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_2ae54f2f37339c7a47224e47e966aa7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_aa61e257a8aa96b6b80a903c633f3b48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e3fb07a0-edde-5c01-a450-db3ac03ce89e/e3fb07a0-edde-5c01-a450-db3ac03ce89e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/b3/71b35239be88a2305ae6684237a85475/pa/PU50365_18fde8792903fde5a10d3e3fc95ad178.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2017-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-04-27 07:55:53 [auto1.it] INFO: Saving data for PU50365: {'created_time': 1777276553.854687, 'last_price_update_time': 1777276553.854699, 'has_photos': True, 'auction_closing_time': 1777388855.0}
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_110d144d07c91325907d0db6d6e45aa9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_4d02bc273fc0d349118f916afe83d7b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_9821ea8c59caa09a83d2ec70541759c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b11c2d9e23d13bd34dcc096108993972.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_e5b64dd712b0f56a694925a1821d4437.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_45138b9d5da9728fb77062f65f617275.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_b7fab3312b56d8ecadbff408abc80e20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545c950>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8eb5a631d5da14390633c0746fdf4ff5.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645ff50>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_1342f7080a0a2fcf126ac98410e47d74.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533f590>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_14cf1ca00ec900bc79e1f357b05d7747.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721d250>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_8d9ba1e05b9f1c5d44ea5c6078664ba2.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533cc10>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43a8139b-869f-5d28-8e30-7a08b935e2bf
2026-04-27 07:55:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43a8139b-869f-5d28-8e30-7a08b935e2bf, skipping ID generation
2026-04-27 07:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43a8139b-869f-5d28-8e30-7a08b935e2bf with scrape type 1
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43a8139b-869f-5d28-8e30-7a08b935e2bf sending to next pipeline
2026-04-27 07:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43a8139b-869f-5d28-8e30-7a08b935e2bf, identifier: JG99232
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6396490>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b44e7f865a784ed5408ba0084bc2e957.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3065d8fc-4043-50fa-a500-2465ce18c416
2026-04-27 07:55:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3065d8fc-4043-50fa-a500-2465ce18c416, skipping ID generation
2026-04-27 07:55:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3065d8fc-4043-50fa-a500-2465ce18c416 with scrape type 1
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3065d8fc-4043-50fa-a500-2465ce18c416 sending to next pipeline
2026-04-27 07:55:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3065d8fc-4043-50fa-a500-2465ce18c416, identifier: HD92307
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533c050>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_108f856285cdfe1845d2539fa96d9170.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645f410>
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_70aa86299da4457dcecfc163c318760f.jpg saved to cache
2026-04-27 07:55:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:55:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-04-27 07:55:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:55:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232
2026-04-27 07:55:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43a8139b-869f-5d28-8e30-7a08b935e2bf with identifier: JG99232 to the API
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Senago',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:51:37Z',
'fuel_type': 'diesel',
'id': '43a8139b-869f-5d28-8e30-7a08b935e2bf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG99232',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Audi',
'model': 'Q2',
'odometer': 286311,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_3ebdbdff25d37498b7036f002a625796.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_aa3aa6d60c64f1ce46882896db9fd9d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_109504ae7ce36d13d60dcbbc0f08cf42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ba226062ac0164a37f41719ebcfbe9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_2ca9dd1713257b2bc235fed8652952e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_b2ad02491a496500a94b7b22e7ca289b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_59d13d4830098c27c65a69b99690adb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_f066eccfc735d341662856ecf2803961.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_296b798f669198ae50daff7cd7c451ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43a8139b-869f-5d28-8e30-7a08b935e2bf/43a8139b-869f-5d28-8e30-7a08b935e2bf_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/de/2bde239312977fc6d69d3a7713bc71a6/pa/JG99232_66198b5e5cb67d8e80da94c7978b0981.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2017-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.6 TDI',
'transmission': 'manual',
'trim': '',
'year': 2017}
2026-04-27 07:55:55 [auto1.it] INFO: Saving data for JG99232: {'created_time': 1777276555.24631, 'last_price_update_time': 1777276555.246321, 'has_photos': True, 'auction_closing_time': 1777391497.0}
2026-04-27 07:55:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3065d8fc-4043-50fa-a500-2465ce18c416 with identifier: HD92307
2026-04-27 07:55:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3065d8fc-4043-50fa-a500-2465ce18c416 with identifier: HD92307
2026-04-27 07:55:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3065d8fc-4043-50fa-a500-2465ce18c416 with identifier: HD92307 to the API
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b44e7f865a784ed5408ba0084bc2e957.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:18:56Z',
'fuel_type': 'diesel',
'id': '3065d8fc-4043-50fa-a500-2465ce18c416',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD92307',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Seat',
'model': 'Alhambra',
'odometer': 147825,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b8da99ccc9cbf5896db9f7bfb1b58dcd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_326b60ed12a159da973943a8e1956ed1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_deb5b0450a9d954279b9547342d085f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ea2226aa10b0607bfc2a45aed550f1c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_b44e7f865a784ed5408ba0084bc2e957.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_2cb9d3a571e3e242b98d3467173cfcf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_ff6109f2f7b90843d7e3949939da6725.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71278,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_17393fe04ce03cc8aa10ef0668a859a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_21ec8f5839c492e6b212b58ec1ac60c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3065d8fc-4043-50fa-a500-2465ce18c416/3065d8fc-4043-50fa-a500-2465ce18c416_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64907,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/ff/4aff97d4118364e0e8e47f3b825e04c6/pa/HD92307_84c0ceae13ca4e03afc4ebd712b69fa2.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2015-10-25',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Alhambra 2.0 TDI Style Advanced',
'transmission': 'automatic',
'trim': 'Style Advanced',
'year': 2015}
2026-04-27 07:55:55 [auto1.it] INFO: Saving data for HD92307: {'created_time': 1777276555.715902, 'last_price_update_time': 1777276555.715915, 'has_photos': True, 'auction_closing_time': 1777389536.0}
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_9a4fb3eaecfa4bd2f828577ca371fe88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_6596730f588da8b70605c9599c15bcdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead573add0>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_110d144d07c91325907d0db6d6e45aa9.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ca77cbc-1748-581a-961b-764a6fdc260e
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ca77cbc-1748-581a-961b-764a6fdc260e, skipping ID generation
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ca77cbc-1748-581a-961b-764a6fdc260e with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ca77cbc-1748-581a-961b-764a6fdc260e sending to next pipeline
2026-04-27 07:55:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ca77cbc-1748-581a-961b-764a6fdc260e, identifier: FT95535
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b1150>
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_4d02bc273fc0d349118f916afe83d7b3.jpg saved to cache
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb144039-eb53-5eb7-9c40-3d4822c16b54
2026-04-27 07:55:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb144039-eb53-5eb7-9c40-3d4822c16b54, skipping ID generation
2026-04-27 07:55:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb144039-eb53-5eb7-9c40-3d4822c16b54 with scrape type 1
2026-04-27 07:55:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb144039-eb53-5eb7-9c40-3d4822c16b54 sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb144039-eb53-5eb7-9c40-3d4822c16b54, identifier: VF37743
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5324dd0>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_9821ea8c59caa09a83d2ec70541759c1.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51a608a2-ad8b-5bc2-bae4-059b3a69603e, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51a608a2-ad8b-5bc2-bae4-059b3a69603e sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51a608a2-ad8b-5bc2-bae4-059b3a69603e, identifier: FK88663
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5453710>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bebe1cb8-2a61-5114-9ba1-2c25ccb03698, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bebe1cb8-2a61-5114-9ba1-2c25ccb03698 sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bebe1cb8-2a61-5114-9ba1-2c25ccb03698, identifier: WR11304
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b950>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b11c2d9e23d13bd34dcc096108993972.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc50140a-8a38-53c2-a782-24480f99b83c
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc50140a-8a38-53c2-a782-24480f99b83c, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cc50140a-8a38-53c2-a782-24480f99b83c with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc50140a-8a38-53c2-a782-24480f99b83c sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cc50140a-8a38-53c2-a782-24480f99b83c, identifier: LT53678
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e34d0>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_e5b64dd712b0f56a694925a1821d4437.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87b679c3-3ed4-57c2-9181-c1a8afcafeba, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87b679c3-3ed4-57c2-9181-c1a8afcafeba sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 87b679c3-3ed4-57c2-9181-c1a8afcafeba, identifier: LM83836
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59592d0>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_45138b9d5da9728fb77062f65f617275.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5490890>
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:55:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:55:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_b7fab3312b56d8ecadbff408abc80e20.jpg saved to cache
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89907b32-3750-52c1-8e9e-bebcef664ef8
2026-04-27 07:55:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89907b32-3750-52c1-8e9e-bebcef664ef8, skipping ID generation
2026-04-27 07:55:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89907b32-3750-52c1-8e9e-bebcef664ef8 with scrape type 1
2026-04-27 07:55:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89907b32-3750-52c1-8e9e-bebcef664ef8 sending to next pipeline
2026-04-27 07:55:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89907b32-3750-52c1-8e9e-bebcef664ef8, identifier: VA51604
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_29fed363b02d4d46ea5b86c6c85d1240.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_c9fe7032c0401fddc3e688fad5da06c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_b691d58bee1d1a73901eb65d26031c8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:55:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ca77cbc-1748-581a-961b-764a6fdc260e with identifier: FT95535
2026-04-27 07:55:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ca77cbc-1748-581a-961b-764a6fdc260e with identifier: FT95535
2026-04-27 07:55:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ca77cbc-1748-581a-961b-764a6fdc260e with identifier: FT95535 to the API
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_110d144d07c91325907d0db6d6e45aa9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 122,
'expiration_date': '2026-04-28T15:28:18Z',
'fuel_type': 'petrol',
'id': '1ca77cbc-1748-581a-961b-764a6fdc260e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT95535',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 182052,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1ae674150f46eec5c3e7a7a0d3553464.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_110d144d07c91325907d0db6d6e45aa9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_b5145d496619fbfe415c1712a71c3452.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8a969564cfad3b552ca72c9ca41257de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_8eb5a631d5da14390633c0746fdf4ff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_54057648d96ed0452051711145c72c26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_02e0b65bfdc4e6beec5c2e7e55570e87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71739,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_1e612bd93ad26c126daa01fc90bc7b27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_d4828feb38dbda9b3065e50dc91ce8d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ca77cbc-1748-581a-961b-764a6fdc260e/1ca77cbc-1748-581a-961b-764a6fdc260e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42244,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4b/bc/4bbcd8830b72027e1d88c76f63399473/pa/FT95535_e9efc9a5d5314b883ce87e940204f530.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Urban',
'transmission': 'manual',
'trim': 'BlueEfficiency Urban',
'year': 2015}
2026-04-27 07:55:57 [auto1.it] INFO: Saving data for FT95535: {'created_time': 1777276557.508867, 'last_price_update_time': 1777276557.508876, 'has_photos': True, 'auction_closing_time': 1777390098.0}
2026-04-27 07:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb144039-eb53-5eb7-9c40-3d4822c16b54 with identifier: VF37743
2026-04-27 07:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb144039-eb53-5eb7-9c40-3d4822c16b54 with identifier: VF37743
2026-04-27 07:55:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb144039-eb53-5eb7-9c40-3d4822c16b54 with identifier: VF37743 to the API
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_4d02bc273fc0d349118f916afe83d7b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 237,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:51:37Z',
'fuel_type': 'diesel',
'id': 'cb144039-eb53-5eb7-9c40-3d4822c16b54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VF37743',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Ford',
'model': 'Transit',
'odometer': 105600,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_fce6a305251e8145070ba2dd1c0d9db7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50271,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_4d02bc273fc0d349118f916afe83d7b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_a49a4032e76b8eb7b8d194b66caab507.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_14cf1ca00ec900bc79e1f357b05d7747.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_1342f7080a0a2fcf126ac98410e47d74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_0f6ec06b929b5ab317bbc2e7635736f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 28898,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_7ca7c166ee5a8845008cac2a3c6436d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_e02c45417982062f204f4663a6a2b7b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_aa9101657c94200fa586385b5948bcee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb144039-eb53-5eb7-9c40-3d4822c16b54/cb144039-eb53-5eb7-9c40-3d4822c16b54_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/31/4331352e3647665843e96357014b9518/pa/VF37743_6c85c0e1021adeda7148f274d0cdeea8.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2021-01-10',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Transit 2.0 TDCi 350 L3 Trend',
'transmission': 'manual',
'trim': '350 L3 Trend',
'year': 2021}
2026-04-27 07:55:57 [auto1.it] INFO: Saving data for VF37743: {'created_time': 1777276557.857165, 'last_price_update_time': 1777276557.857175, 'has_photos': True, 'auction_closing_time': 1777391497.0}
2026-04-27 07:55:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51a608a2-ad8b-5bc2-bae4-059b3a69603e with identifier: FK88663
2026-04-27 07:55:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51a608a2-ad8b-5bc2-bae4-059b3a69603e with identifier: FK88663
2026-04-27 07:55:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51a608a2-ad8b-5bc2-bae4-059b3a69603e with identifier: FK88663 to the API
2026-04-27 07:55:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_9821ea8c59caa09a83d2ec70541759c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'city': 'Decimomannu',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:44:56Z',
'fuel_type': 'diesel',
'id': '51a608a2-ad8b-5bc2-bae4-059b3a69603e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 39.3103,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK88663',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'location_confidence': 'geocoded',
'longitude': 8.9696,
'make': 'Volvo',
'model': 'XC60',
'odometer': 316656,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f4365e887ae9ca1db461620b317cfabe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_9821ea8c59caa09a83d2ec70541759c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_ff1dd9772f4414fb38ede5edb7fbe2b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_fbe6c8167c2b8ecc631acd666d234ff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_8ee1631b6fbd81610ffc78420d2806fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_f8d43077952ff8c34966bc209ec94b35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_4237b25c7da28ff1c723215afccdbc7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_89c6ebf007e0ea9394faae9035344159.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_6b5417b1704aa758c62b8b783202c832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51a608a2-ad8b-5bc2-bae4-059b3a69603e/51a608a2-ad8b-5bc2-bae4-059b3a69603e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga5/0e/a50eadfb2d30858f45bcc03ce6cfe03c/pa/FK88663_0f88258be506467712870ddd27877013.jpg',
'Width': 800}],
'postal_code': '09033',
'price': 0,
'price_includes_vat': True,
'province': 'Cagliari',
'province_code': 'IT-CA',
'region': 'Sardegna',
'region_code': 'IT-14',
'registration_date': '2014-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 D3 Momentum 2WD',
'transmission': 'automatic',
'trim': 'Momentum 2WD',
'year': 2014}
2026-04-27 07:55:58 [auto1.it] INFO: Saving data for FK88663: {'created_time': 1777276558.211239, 'last_price_update_time': 1777276558.211252, 'has_photos': True, 'auction_closing_time': 1777391096.0}
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bebe1cb8-2a61-5114-9ba1-2c25ccb03698 with identifier: WR11304 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'city': 'Capannori',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:21:52Z',
'fuel_type': 'diesel',
'id': 'bebe1cb8-2a61-5114-9ba1-2c25ccb03698',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WR11304',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Dacia',
'model': 'Duster',
'odometer': 59330,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fd601fdc16f7532675122535e7ba4976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_5416ee22654ba5758a9235dffbb8e4d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_b4b28c4786c55e8ee3fa5ccb3f8a8b76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_a1f15c9f27e0a484ac53af197eb68df1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56180,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_fc3dcb4b993cbd7a7725571f23231f2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_00df067aef858d5f609409bd6598e1a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_1b92cc4bb7073f64caa86851198af20c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66688,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_f793f1d9f08f92e3d87e5af6c0faa8e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_774e36b5a1ef9c2d6275ae193fc1ad8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bebe1cb8-2a61-5114-9ba1-2c25ccb03698/bebe1cb8-2a61-5114-9ba1-2c25ccb03698_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/75/3c75e658c72f24d785a1ecee17da36df/pa/WR11304_89acf8fc33056768cc57993ad2cb56e2.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2021-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2021}
2026-04-27 07:55:58 [auto1.it] INFO: Saving data for WR11304: {'created_time': 1777276558.682283, 'last_price_update_time': 1777276558.682295, 'has_photos': True, 'auction_closing_time': 1777389712.0}
2026-04-27 07:55:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-04-27 07:55:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678
2026-04-27 07:55:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cc50140a-8a38-53c2-a782-24480f99b83c with identifier: LT53678 to the API
2026-04-27 07:55:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b11c2d9e23d13bd34dcc096108993972.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'Settimo Torinese',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:40:35Z',
'fuel_type': 'diesel',
'id': 'cc50140a-8a38-53c2-a782-24480f99b83c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT53678',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Audi',
'model': 'A4',
'odometer': 369060,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_c4af13a72149e7a78ee429ba342ada43.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f4c293d5c2301d121c8c58801351aec3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_e1e8e034a7ca17c3e42705d98bcfa88c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_d451151d0aa6781e87c58fb37e9592bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_be2fc461b4a2480941d853dfde0c106c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b11c2d9e23d13bd34dcc096108993972.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48750,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_f73745d60762a51cf3f019a99574276e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_8d9ba1e05b9f1c5d44ea5c6078664ba2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_b9aa73b3acc18568243090c1157d5506.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cc50140a-8a38-53c2-a782-24480f99b83c/cc50140a-8a38-53c2-a782-24480f99b83c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71338,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/a5/63a5e71486c9705da940c6e083df7f95/pa/LT53678_65f631912bcd5c916952fc7605da1bd6.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2018-12-16',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 35 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-04-27 07:55:59 [auto1.it] INFO: Saving data for LT53678: {'created_time': 1777276559.255702, 'last_price_update_time': 1777276559.255713, 'has_photos': True, 'auction_closing_time': 1777390835.0}
2026-04-27 07:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 87b679c3-3ed4-57c2-9181-c1a8afcafeba with identifier: LM83836
2026-04-27 07:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 87b679c3-3ed4-57c2-9181-c1a8afcafeba with identifier: LM83836
2026-04-27 07:55:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:55:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 87b679c3-3ed4-57c2-9181-c1a8afcafeba with identifier: LM83836 to the API
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:55:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:55:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_e5b64dd712b0f56a694925a1821d4437.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': 'Rental',
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:15:02Z',
'fuel_type': 'diesel',
'id': '87b679c3-3ed4-57c2-9181-c1a8afcafeba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LM83836',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 227759,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71456,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_d26943cc515e05e213774d5182b1bb26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72419,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_e5b64dd712b0f56a694925a1821d4437.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_31aa8c40ddffd09e719eafa03e4b81e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_34ab6fa8c410be506d29eb5381558b94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_87b679c3-3ed4-57c2-9181-c1a8afcafeba/87b679c3-3ed4-57c2-9181-c1a8afcafeba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge0/3a/e03a2132b47109125c0686f1268f0711/pa/LM83836_72dd87a6c3a6e11d280f7b8d15bbb4fd.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2011-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto Evo 1.3 JTD Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2011}
2026-04-27 07:55:59 [auto1.it] INFO: Saving data for LM83836: {'created_time': 1777276559.854129, 'last_price_update_time': 1777276559.854139, 'has_photos': True, 'auction_closing_time': 1777389302.0}
2026-04-27 07:55:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89907b32-3750-52c1-8e9e-bebcef664ef8 with identifier: VA51604
2026-04-27 07:55:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89907b32-3750-52c1-8e9e-bebcef664ef8 with identifier: VA51604
2026-04-27 07:56:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89907b32-3750-52c1-8e9e-bebcef664ef8 with identifier: VA51604 to the API
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_b7fab3312b56d8ecadbff408abc80e20.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 117,
'expiration_date': '2026-04-28T15:54:01Z',
'fuel_type': 'petrol',
'id': '89907b32-3750-52c1-8e9e-bebcef664ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VA51604',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Nissan',
'model': 'Juke',
'odometer': 114453,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76320,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_d2a1fde33f7b5d861a0aa1f7ab99735f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_837df870f6e744446ea7b986c934444e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_07543780012f2af98fbb8c79f9a05c90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_03f6a6f7f533d2213548e617b4c8703a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_ed1ff6afa6b24dd7ede060e1a773f8a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_b7fab3312b56d8ecadbff408abc80e20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_7f75aac28c9a2f6c44cf9eb464923c87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_70aa86299da4457dcecfc163c318760f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_108f856285cdfe1845d2539fa96d9170.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89907b32-3750-52c1-8e9e-bebcef664ef8/89907b32-3750-52c1-8e9e-bebcef664ef8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60240,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf8/1e/f81e09c357a8be2e8a2379648a05cf97/pa/VA51604_874bdd76272eb47a9b40108168306329.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2010-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.6 Tekna',
'transmission': 'manual',
'trim': 'Tekna',
'year': 2010}
2026-04-27 07:56:00 [auto1.it] INFO: Saving data for VA51604: {'created_time': 1777276560.30988, 'last_price_update_time': 1777276560.309892, 'has_photos': True, 'auction_closing_time': 1777391641.0}
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f6690>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_9a4fb3eaecfa4bd2f828577ca371fe88.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82274f43-50f3-585b-92ed-f1eef95a51b2
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82274f43-50f3-585b-92ed-f1eef95a51b2, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82274f43-50f3-585b-92ed-f1eef95a51b2 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82274f43-50f3-585b-92ed-f1eef95a51b2 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82274f43-50f3-585b-92ed-f1eef95a51b2, identifier: DB07340
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54591d0>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_6596730f588da8b70605c9599c15bcdb.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f7650>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_29fed363b02d4d46ea5b86c6c85d1240.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ae4f036-f299-5d3a-a479-901ddcf16085
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ae4f036-f299-5d3a-a479-901ddcf16085, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae4f036-f299-5d3a-a479-901ddcf16085 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ae4f036-f299-5d3a-a479-901ddcf16085 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8ae4f036-f299-5d3a-a479-901ddcf16085, identifier: VX22650
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5755410>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7ebd939-dde9-544e-83bf-0dca02f95948
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7ebd939-dde9-544e-83bf-0dca02f95948, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7ebd939-dde9-544e-83bf-0dca02f95948 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7ebd939-dde9-544e-83bf-0dca02f95948 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7ebd939-dde9-544e-83bf-0dca02f95948, identifier: DE18860
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548ac90>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_c9fe7032c0401fddc3e688fad5da06c9.jpg saved to cache
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a081839e-3c46-5d24-be28-16fd2abd5cd1
2026-04-27 07:56:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a081839e-3c46-5d24-be28-16fd2abd5cd1, skipping ID generation
2026-04-27 07:56:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a081839e-3c46-5d24-be28-16fd2abd5cd1 with scrape type 1
2026-04-27 07:56:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a081839e-3c46-5d24-be28-16fd2abd5cd1 sending to next pipeline
2026-04-27 07:56:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a081839e-3c46-5d24-be28-16fd2abd5cd1, identifier: SV14181
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5484150>
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_b691d58bee1d1a73901eb65d26031c8f.jpg saved to cache
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5b04a94-1a35-5d16-b131-37b482c7dbee
2026-04-27 07:56:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5b04a94-1a35-5d16-b131-37b482c7dbee, skipping ID generation
2026-04-27 07:56:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5b04a94-1a35-5d16-b131-37b482c7dbee with scrape type 1
2026-04-27 07:56:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5b04a94-1a35-5d16-b131-37b482c7dbee sending to next pipeline
2026-04-27 07:56:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f5b04a94-1a35-5d16-b131-37b482c7dbee, identifier: HR92713
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82274f43-50f3-585b-92ed-f1eef95a51b2 with identifier: DB07340
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82274f43-50f3-585b-92ed-f1eef95a51b2 with identifier: DB07340
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82274f43-50f3-585b-92ed-f1eef95a51b2 with identifier: DB07340 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_9a4fb3eaecfa4bd2f828577ca371fe88.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'city': 'Padova',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:03:18Z',
'fuel_type': 'diesel',
'id': '82274f43-50f3-585b-92ed-f1eef95a51b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB07340',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'MINI',
'model': 'Countryman',
'odometer': 143076,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a49bd7098e76fed1bcf3b62be1db2f6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_0641819048c21e189c69b823564ada5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_09800fce9f9880fc6871261db68b2a2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56818,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_b905ba5ccb42c9eebd4ab8e68b88e1cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_a14c476e92dda3c694582240cc2029ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_20a787a61b769d400672cf504cefc849.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_31abe9e0d6a66689751f7fab642dfc0d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_ba785cfc76c3d3f67fe416a01639aa1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_9a4fb3eaecfa4bd2f828577ca371fe88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82274f43-50f3-585b-92ed-f1eef95a51b2/82274f43-50f3-585b-92ed-f1eef95a51b2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/b6/acb694dab520ec124f6177e43b981665/pa/DB07340_45138b9d5da9728fb77062f65f617275.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2015-10-26',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper D',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 07:56:01 [auto1.it] INFO: Saving data for DB07340: {'created_time': 1777276561.452791, 'last_price_update_time': 1777276561.452804, 'has_photos': True, 'auction_closing_time': 1777388598.0}
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8ae4f036-f299-5d3a-a479-901ddcf16085 with identifier: VX22650
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8ae4f036-f299-5d3a-a479-901ddcf16085 with identifier: VX22650
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8ae4f036-f299-5d3a-a479-901ddcf16085 with identifier: VX22650 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_29fed363b02d4d46ea5b86c6c85d1240.jpg>
{'auction_title': '',
'c_o_2_emission_value': 89,
'category': None,
'city': 'Decimomannu',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.8L',
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:40:20Z',
'fuel_type': 'hybrid',
'id': '8ae4f036-f299-5d3a-a479-901ddcf16085',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 39.3103,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VX22650',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'location_confidence': 'geocoded',
'longitude': 8.9696,
'make': 'Toyota',
'model': 'Prius',
'odometer': 312711,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_808d35689dc6466453ef99af569d4da0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_6596730f588da8b70605c9599c15bcdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_29fed363b02d4d46ea5b86c6c85d1240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_c2eb4c2326865be21e4519f6b84ac560.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8ae4f036-f299-5d3a-a479-901ddcf16085/8ae4f036-f299-5d3a-a479-901ddcf16085_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img44/20/4420da28425bd90e6c82178091482568/pa/VX22650_9258bfe2ccb8ae6c6dcc22576fb59c41.jpg',
'Width': 800}],
'postal_code': '09033',
'price': 0,
'price_includes_vat': True,
'province': 'Cagliari',
'province_code': 'IT-CA',
'region': 'Sardegna',
'region_code': 'IT-14',
'registration_date': '2009-07-12',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Prius 1.8 Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2009}
2026-04-27 07:56:01 [auto1.it] INFO: Saving data for VX22650: {'created_time': 1777276561.847536, 'last_price_update_time': 1777276561.84755, 'has_photos': True, 'auction_closing_time': 1777390820.0}
2026-04-27 07:56:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-04-27 07:56:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860
2026-04-27 07:56:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7ebd939-dde9-544e-83bf-0dca02f95948 with identifier: DE18860 to the API
2026-04-27 07:56:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Castelnuovo Del Garda',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 80,
'expiration_date': '2026-04-28T15:18:47Z',
'fuel_type': 'petrol',
'id': 'd7ebd939-dde9-544e-83bf-0dca02f95948',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DE18860',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Nissan',
'model': 'Micra',
'odometer': 150019,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_71cd389dbb98110504cfa037529577ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_f21902c1ab655978fd9e08e0846a9dab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_384625eff70509df997b29189654c41b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_ec85b2f067007d50d83203e1b147bcf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7ebd939-dde9-544e-83bf-0dca02f95948/d7ebd939-dde9-544e-83bf-0dca02f95948_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/89/fd89738f1197d3c304202c5c76447931/pa/DE18860_952a240ac749349f7d713911408d959c.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2014-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Micra 1.2 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2014}
2026-04-27 07:56:02 [auto1.it] INFO: Saving data for DE18860: {'created_time': 1777276562.292446, 'last_price_update_time': 1777276562.292461, 'has_photos': True, 'auction_closing_time': 1777389527.0}
2026-04-27 07:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a081839e-3c46-5d24-be28-16fd2abd5cd1 with identifier: SV14181
2026-04-27 07:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a081839e-3c46-5d24-be28-16fd2abd5cd1 with identifier: SV14181
2026-04-27 07:56:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a081839e-3c46-5d24-be28-16fd2abd5cd1 with identifier: SV14181 to the API
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_c9fe7032c0401fddc3e688fad5da06c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'city': 'Milazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:13:00Z',
'fuel_type': 'diesel',
'id': 'a081839e-3c46-5d24-be28-16fd2abd5cd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV14181',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Alfa Romeo',
'model': 'Alfa 147',
'odometer': 124905,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_c9fe7032c0401fddc3e688fad5da06c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_a6b048dacd0ff4775fdc818fc02bb878.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_137308f1c023c70cf19c1b885d33e942.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_adc55a505577afe08a22727dd0bbe736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88985,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_803703b5769910e538dc0936181e882d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a081839e-3c46-5d24-be28-16fd2abd5cd1/a081839e-3c46-5d24-be28-16fd2abd5cd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/7d/907dd77dcbd466985066cddcdfcd9add/pa/SV14181_d6cec7e5cfefc8f5cd097bbe8c78827c.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2010-04-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Alfa 147 1.9 JTD JTDM Progression',
'transmission': 'manual',
'trim': 'JTDM Progression',
'year': 2010}
2026-04-27 07:56:02 [auto1.it] INFO: Saving data for SV14181: {'created_time': 1777276562.770105, 'last_price_update_time': 1777276562.770117, 'has_photos': True, 'auction_closing_time': 1777389180.0}
2026-04-27 07:56:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-04-27 07:56:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713
2026-04-27 07:56:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f5b04a94-1a35-5d16-b131-37b482c7dbee with identifier: HR92713 to the API
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_b691d58bee1d1a73901eb65d26031c8f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:21:20Z',
'fuel_type': 'diesel',
'id': 'f5b04a94-1a35-5d16-b131-37b482c7dbee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HR92713',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Honda',
'model': 'CR-V',
'odometer': 218083,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_b691d58bee1d1a73901eb65d26031c8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_5775f1fbd0774ab6a0cc3ca18e2738ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_1dfe9afbab60164d38fe380314d46510.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_d9db2df23006896ec0d65f8ebe938c02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_05fd831b2c9460a4ad67f41c32d53816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69087,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_87d3a2b699819b72faf3f8b77766c7dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_11223980b201f29d1a6f7c3711465926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_66198ccc434ef1f9fd211b5f1adf0913.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_f1e5570569bf0f6f8626065f3046c2a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f5b04a94-1a35-5d16-b131-37b482c7dbee/f5b04a94-1a35-5d16-b131-37b482c7dbee_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61601,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img51/05/5105932a7716ce18b7d556fc3915c956/pa/HR92713_cd9207c32ee7b29f70dcc770422109f1.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2009-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Honda CR-V 2.2 CTDI Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2009}
2026-04-27 07:56:03 [auto1.it] INFO: Saving data for HR92713: {'created_time': 1777276563.101081, 'last_price_update_time': 1777276563.101091, 'has_photos': True, 'auction_closing_time': 1777389680.0}
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN94026> (referer: https://www.auto1.com/v1/car-details-view/PN94026/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SA42409/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NT74531/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NM97698/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FM45145> (referer: https://www.auto1.com/v1/car-details-view/FM45145/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5081e183-2f81-5c56-9884-f268bdcbf64c with identifier: PN94026
2026-04-27 07:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5081e183-2f81-5c56-9884-f268bdcbf64c with scrape type 1
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_2c09c5e1e7f537d929047b6f57911c09.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_bddf7aa0656027428f8abe42e16c500a.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with identifier: FM45145
2026-04-27 07:56:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with scrape type 1
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_5f2401bf4965d8a3d9a3e1398b8f83c4.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_b37b4746f0e7da58b6138fe2132bd26f.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_35c0adaf4024f845c7c5dcce704fce60.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_ebb46ca6122e21f8e94752de3d0ec37d.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_595969b6f47f84143c968cfe47dd9618.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_71ba40c74750984d15a3a837336574cf.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_eb73b79843afb2f06b88c3a55cc5b00a.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cc4c52ded9c105eefa7c829bab529bf5.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_3633f48df1db35914d51177a42526e65.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d61832f890d82ba2b1bd3a57343168b1.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_14b1629e7c579ec1aeaa62dad8de021a.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cfec8c75a36966df8e7a26a20eb10429.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_1e73e12704e65af326a7e5455e84dd9f.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_4302ba054dd44b8cef8cded6f8feea98.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_2c2ced6e8a6c7856dc093368ff3c34d6.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YV30148/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d97d99726c532a39b07c40829d09fd6f.jpg not downloaded yet
2026-04-27 07:56:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_f64dda58fe25fe915941dedfcad7f440.jpg not downloaded yet
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_372a62c6bc2a99ffb6ba40b25ddd9bd1.jpg not downloaded yet
2026-04-27 07:56:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_4302ba054dd44b8cef8cded6f8feea98.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649e890>
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_4302ba054dd44b8cef8cded6f8feea98.jpg saved to cache
2026-04-27 07:56:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XF01774/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH07211> (referer: https://www.auto1.com/v1/car-details-view/HH07211/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TU31617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XJ02099/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc2a24c-2c30-5ab7-9725-bad43f159140 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_cfb0acb3e3dac2b3e9aceb971d6b2d46.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f4d645e814ad1968a453e70236ccd7ec.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_20b3ea642c701636370786c5f802d6f8.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PN84463> (referer: https://www.auto1.com/v1/car-details-view/PN84463/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_2c2ced6e8a6c7856dc093368ff3c34d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_372a62c6bc2a99ffb6ba40b25ddd9bd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_1586f454b1315d143eeb82a888b9b2fe.jpg not downloaded yet
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f7fc850f04e1ef16ec489993751f0646.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_dd2d1275a528a25b0ece3656f5f038fb.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_f64dda58fe25fe915941dedfcad7f440.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d97d99726c532a39b07c40829d09fd6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_333b9d36eb3f4db8d1be89987aa18cba.jpg not downloaded yet
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_7a583d0952ee0307362a773dba41ca1e.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XL05283/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_181f982f471c5fa4db767cf5f41ba616.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f4d645e814ad1968a453e70236ccd7ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_720f01ea2ad349fc3150b96dbf74471d.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DR60838/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bfdff570-5a03-5637-a870-fa2394aefb54 with identifier: PN84463
2026-04-27 07:56:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfdff570-5a03-5637-a870-fa2394aefb54 with scrape type 1
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_59ffa0e16a98ff0b86dc7ebdbe3fba85.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65e34d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_2c2ced6e8a6c7856dc093368ff3c34d6.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5697b10>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_372a62c6bc2a99ffb6ba40b25ddd9bd1.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_dd2d1275a528a25b0ece3656f5f038fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f7fc850f04e1ef16ec489993751f0646.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_333b9d36eb3f4db8d1be89987aa18cba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0b666df5b60828d82c559fc08cd5a484.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_20b3ea642c701636370786c5f802d6f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_181f982f471c5fa4db767cf5f41ba616.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d9de451a0b82ccd0e7f52974bc83e575.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bc4d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_f64dda58fe25fe915941dedfcad7f440.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c5650>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d97d99726c532a39b07c40829d09fd6f.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642d390>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f4d645e814ad1968a453e70236ccd7ec.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d2d856def4089ef4fe4a646ef32f1cdc.jpg not downloaded yet
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_59ffa0e16a98ff0b86dc7ebdbe3fba85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_1586f454b1315d143eeb82a888b9b2fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_7a583d0952ee0307362a773dba41ca1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_720f01ea2ad349fc3150b96dbf74471d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0f18404ea90d9bad7992269ef2e44949.jpg not downloaded yet
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533c2d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_dd2d1275a528a25b0ece3656f5f038fb.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943c10>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f7fc850f04e1ef16ec489993751f0646.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ee90>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_333b9d36eb3f4db8d1be89987aa18cba.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead532e5d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_20b3ea642c701636370786c5f802d6f8.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649c1d0>
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_181f982f471c5fa4db767cf5f41ba616.jpg saved to cache
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_cfb0acb3e3dac2b3e9aceb971d6b2d46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_e9659387dc762dd308c3af685396dda2.jpg not downloaded yet
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB21565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5210>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_59ffa0e16a98ff0b86dc7ebdbe3fba85.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568e250>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_1586f454b1315d143eeb82a888b9b2fe.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54ae750>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_7a583d0952ee0307362a773dba41ca1e.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c2a50>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_720f01ea2ad349fc3150b96dbf74471d.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_9e119586a6d71912e00aabfff518517b.jpg not downloaded yet
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d9de451a0b82ccd0e7f52974bc83e575.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0b666df5b60828d82c559fc08cd5a484.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN95264> (referer: https://www.auto1.com/v1/car-details-view/DN95264/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BS51992/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_10c1dab0b485f741982312ff21ada9bb.jpg not downloaded yet
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP81137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ84220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589b690>
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_cfb0acb3e3dac2b3e9aceb971d6b2d46.jpg saved to cache
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fc2a24c-2c30-5ab7-9725-bad43f159140
2026-04-27 07:56:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fc2a24c-2c30-5ab7-9725-bad43f159140, skipping ID generation
2026-04-27 07:56:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0fc2a24c-2c30-5ab7-9725-bad43f159140 with scrape type 1
2026-04-27 07:56:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fc2a24c-2c30-5ab7-9725-bad43f159140 sending to next pipeline
2026-04-27 07:56:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0fc2a24c-2c30-5ab7-9725-bad43f159140, identifier: HH07211
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-04-27 07:56:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211
2026-04-27 07:56:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0fc2a24c-2c30-5ab7-9725-bad43f159140 with identifier: HH07211 to the API
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_cfb0acb3e3dac2b3e9aceb971d6b2d46.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:53:31Z',
'fuel_type': 'diesel',
'id': '0fc2a24c-2c30-5ab7-9725-bad43f159140',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH07211',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'BMW',
'model': '1er',
'odometer': 206695,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_cfb0acb3e3dac2b3e9aceb971d6b2d46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f4d645e814ad1968a453e70236ccd7ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_20b3ea642c701636370786c5f802d6f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87820,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_1586f454b1315d143eeb82a888b9b2fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_f7fc850f04e1ef16ec489993751f0646.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_dd2d1275a528a25b0ece3656f5f038fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_333b9d36eb3f4db8d1be89987aa18cba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_7a583d0952ee0307362a773dba41ca1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_181f982f471c5fa4db767cf5f41ba616.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0fc2a24c-2c30-5ab7-9725-bad43f159140/0fc2a24c-2c30-5ab7-9725-bad43f159140_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/90/7d90a2b0244cf25fc50b5d582439b45b/pa/HH07211_720f01ea2ad349fc3150b96dbf74471d.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-04-27 07:56:05 [auto1.it] INFO: Saving data for HH07211: {'created_time': 1777276565.984338, 'last_price_update_time': 1777276565.984347, 'has_photos': True, 'auction_closing_time': 1777391611.0}
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_f423f5fa1be0363c28e7547445bca66a.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d2d856def4089ef4fe4a646ef32f1cdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0f18404ea90d9bad7992269ef2e44949.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_e9659387dc762dd308c3af685396dda2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW25122> (referer: https://www.auto1.com/v1/car-details-view/SW25122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_8110dbf7210277bf4229df96b6ad0ad4.jpg not downloaded yet
2026-04-27 07:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XZ72452> (referer: https://www.auto1.com/v1/car-details-view/XZ72452/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59e9110>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d9de451a0b82ccd0e7f52974bc83e575.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ac390>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0b666df5b60828d82c559fc08cd5a484.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with identifier: DN95264
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_42055db8e9cc67000e0eadb1e7a79ef9.jpg not downloaded yet
2026-04-27 07:56:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_9e119586a6d71912e00aabfff518517b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_087ebdd80166ebfb519c8d4bcefff065.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_14b1629e7c579ec1aeaa62dad8de021a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5332c50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d2d856def4089ef4fe4a646ef32f1cdc.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead570b210>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0f18404ea90d9bad7992269ef2e44949.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6464d50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_e9659387dc762dd308c3af685396dda2.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43018d47-f67c-580c-bdff-dc896cf4ced3 with identifier: SW25122
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43018d47-f67c-580c-bdff-dc896cf4ced3 with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_b208ace24d1dd1cad1eaace85c4b83f3.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cfec8c75a36966df8e7a26a20eb10429.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_849495a0fa0897a224d17f710408d049.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d61832f890d82ba2b1bd3a57343168b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_1e73e12704e65af326a7e5455e84dd9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_c31a81d6417ce247c43262fb26eaeeb0.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with identifier: XZ72452
2026-04-27 07:56:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with scrape type 1
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5070232d17681db49ce19528c803f4cb.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_10c1dab0b485f741982312ff21ada9bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_ca77fd8c91a559ce50e9fa6a8437d04e.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_f423f5fa1be0363c28e7547445bca66a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f5257c0b5624006e4db3d512fa485497.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_8e552974293fec67c6818c97c880f6c7.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1d50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_9e119586a6d71912e00aabfff518517b.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65d9a50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_14b1629e7c579ec1aeaa62dad8de021a.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_3633f48df1db35914d51177a42526e65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_31eebf2d33bc32befb8024e342ccb935.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_b208ace24d1dd1cad1eaace85c4b83f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f33be55bb09ec11a836b5a6024245294.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_3dd63f6fcf7adf5e0be53fe82dd515e1.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_087ebdd80166ebfb519c8d4bcefff065.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_fa1acd44623466c34b4f3a843247c815.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642df50>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cfec8c75a36966df8e7a26a20eb10429.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a2990>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d61832f890d82ba2b1bd3a57343168b1.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56df090>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_1e73e12704e65af326a7e5455e84dd9f.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a6fcd0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_10c1dab0b485f741982312ff21ada9bb.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552c5d0>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_f423f5fa1be0363c28e7547445bca66a.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f7d736d1b002b64563da6ff19f162aee.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5cb29d2b894805afa11e09a64976fac7.jpg not downloaded yet
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_ca77fd8c91a559ce50e9fa6a8437d04e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_849495a0fa0897a224d17f710408d049.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5070232d17681db49ce19528c803f4cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_6864d87fa68106fda0fca77f91d516e7.jpg not downloaded yet
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_bcdde55157d68b1b156d9fc47408c516.jpg not downloaded yet
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f3010>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_3633f48df1db35914d51177a42526e65.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5586710>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_b208ace24d1dd1cad1eaace85c4b83f3.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d5750>
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_087ebdd80166ebfb519c8d4bcefff065.jpg saved to cache
2026-04-27 07:56:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_8e552974293fec67c6818c97c880f6c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_d13f3239436b4c1660122966a9eb019f.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_9d64aad3c448a370b0a09f699493c835.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_31eebf2d33bc32befb8024e342ccb935.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_0721a38fe1d832f81c64270e13364f30.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TU31617> (referer: https://www.auto1.com/v1/car-details-view/TU31617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a02d0>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_ca77fd8c91a559ce50e9fa6a8437d04e.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581e810>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_849495a0fa0897a224d17f710408d049.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d5e10>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5070232d17681db49ce19528c803f4cb.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_a670f3a6e2b457c5995be79ee720f12b.jpg not downloaded yet
2026-04-27 07:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_6864d87fa68106fda0fca77f91d516e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_fa1acd44623466c34b4f3a843247c815.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_b8308c8caeb480026c509568f423f3df.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5cb29d2b894805afa11e09a64976fac7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_2f3e85f27d80b133c195a788530a64e5.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DR60838> (referer: https://www.auto1.com/v1/car-details-view/DR60838/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a97f50>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_8e552974293fec67c6818c97c880f6c7.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476050>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_31eebf2d33bc32befb8024e342ccb935.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with identifier: TU31617
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_b209540acede3a4a113b7433b1e050a4.jpg not downloaded yet
2026-04-27 07:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f7d736d1b002b64563da6ff19f162aee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_aff790d185bb08a904c5ff4fb5b824c9.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_7c1d8ef78400eb4c67db55a8898a0b66.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YV30148> (referer: https://www.auto1.com/v1/car-details-view/YV30148/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XL05283> (referer: https://www.auto1.com/v1/car-details-view/XL05283/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_d13f3239436b4c1660122966a9eb019f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59cba50>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_6864d87fa68106fda0fca77f91d516e7.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555d390>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_fa1acd44623466c34b4f3a843247c815.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5553050>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5cb29d2b894805afa11e09a64976fac7.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_94641f0bb179378abe85f311751be5a6.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d6e2f268ae41ec2213dc4a5d5a67cad1.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_b8308c8caeb480026c509568f423f3df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_0721a38fe1d832f81c64270e13364f30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_9d64aad3c448a370b0a09f699493c835.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d93832f3ade4a2847e3e595178f82178.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XF01774> (referer: https://www.auto1.com/v1/car-details-view/XF01774/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e72306b9-84e5-5092-a509-09187cf2419f with identifier: DR60838
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72306b9-84e5-5092-a509-09187cf2419f with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4cfda0c811ef06366bc9e715b42b6070.jpg not downloaded yet
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab8910>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f7d736d1b002b64563da6ff19f162aee.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_788d4468429f0459e6357ad5f3894846.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e397173d-23c1-5766-863a-b6686a08b79b with identifier: XL05283
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e397173d-23c1-5766-863a-b6686a08b79b with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_386c1ebfa164555653b1d489e7bf4ba0.jpg not downloaded yet
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5753010>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_d13f3239436b4c1660122966a9eb019f.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_b209540acede3a4a113b7433b1e050a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_bcdde55157d68b1b156d9fc47408c516.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_a670f3a6e2b457c5995be79ee720f12b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_947519589b3d295f8cfe1c3db52839ad.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4d10df41af9ab477bcb7cb2762546f30.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_5db36d09efafc39927e4555085a1c544.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_9cf1c64a91224bf784378b0aeab3e090.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_2f3e85f27d80b133c195a788530a64e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552f510>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_b8308c8caeb480026c509568f423f3df.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ecf10>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_0721a38fe1d832f81c64270e13364f30.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5b10>
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_9d64aad3c448a370b0a09f699493c835.jpg saved to cache
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e1a4eed-5add-51ec-92ad-ade54622b49c with identifier: XF01774
2026-04-27 07:56:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e1a4eed-5add-51ec-92ad-ade54622b49c with scrape type 1
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_3013d83d58aea32fb714c9de4ac6232b.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_35e326e32a00a6c59b1e91190a27c908.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_b9f50fde06298274912637180056c4c7.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_b11e8a86b32b80d8dd8dbeef982c2c60.jpg not downloaded yet
2026-04-27 07:56:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_883fca8483ca0e717023e52fd90001c1.jpg not downloaded yet
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f33be55bb09ec11a836b5a6024245294.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_7c1d8ef78400eb4c67db55a8898a0b66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_3dd63f6fcf7adf5e0be53fe82dd515e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d6e2f268ae41ec2213dc4a5d5a67cad1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a3009543c2a03d0035cdc6a00dab2733.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_6f1fcdef85ffdd96a7ff8f586d607e96.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_33442ff0705e2e8c4f885ff262e2d356.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_3e86bbb69a16d0630552a4363fe1a7a0.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_59d680085bcb64fda1a881f5aaaa8096.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XJ02099> (referer: https://www.auto1.com/v1/car-details-view/XJ02099/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f6e50>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_b209540acede3a4a113b7433b1e050a4.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725ee10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_bcdde55157d68b1b156d9fc47408c516.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580d590>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_a670f3a6e2b457c5995be79ee720f12b.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580e810>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_2f3e85f27d80b133c195a788530a64e5.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_94641f0bb179378abe85f311751be5a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_78b1bc8efe5b3263302b4a054efb3df7.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_386c1ebfa164555653b1d489e7bf4ba0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_aff790d185bb08a904c5ff4fb5b824c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f5257c0b5624006e4db3d512fa485497.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_2ddfb7b2df14dfe97e9811a5938897a5.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_08aa639a917125ca5630f43ab8bdf520.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_17a5529a1880b64dc9dc486a46b9b390.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_a577e7acf4eb92e1310278202726194d.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_21afae67c1727d9a054e7e07a5a87e00.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ84220> (referer: https://www.auto1.com/v1/car-details-view/EZ84220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP81137> (referer: https://www.auto1.com/v1/car-details-view/PP81137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS51992> (referer: https://www.auto1.com/v1/car-details-view/BS51992/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647fd0>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f33be55bb09ec11a836b5a6024245294.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5574d10>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_7c1d8ef78400eb4c67db55a8898a0b66.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567bad0>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_3dd63f6fcf7adf5e0be53fe82dd515e1.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5646410>
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d6e2f268ae41ec2213dc4a5d5a67cad1.jpg saved to cache
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a649dd0a-fc9c-5db9-9b65-624bda30f0ec with identifier: XJ02099
2026-04-27 07:56:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec with scrape type 1
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_ebc6fcc40e881d20d6942a9528178f04.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_788d4468429f0459e6357ad5f3894846.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4cfda0c811ef06366bc9e715b42b6070.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_f34400e9083ae54f8006d2781ecdbc1e.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_491193019282e22fc3a51d6acd530786.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_874a16d81f12cabfa338dd6495f766a0.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_b11e8a86b32b80d8dd8dbeef982c2c60.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_68446866a1f6e3d69578b2201b7f1835.jpg not downloaded yet
2026-04-27 07:56:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_aed7212db3f095912a170802e75fc4be.jpg not downloaded yet
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_883fca8483ca0e717023e52fd90001c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_b9f50fde06298274912637180056c4c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_065415d5c40906e5e2c91ac12ef8252a.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_69964037ce9c64b32bfac31bbdf06420.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_122b6058264558f8609c5f8e0e821cd2.jpg not downloaded yet
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5542290>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_94641f0bb179378abe85f311751be5a6.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ff6d0>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_386c1ebfa164555653b1d489e7bf4ba0.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a7c10>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_aff790d185bb08a904c5ff4fb5b824c9.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b, skipping ID generation
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b sending to next pipeline
2026-04-27 07:56:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b, identifier: XZ72452
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927f10>
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f5257c0b5624006e4db3d512fa485497.jpg saved to cache
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41d0992-9d34-59cf-8948-446e95d883fd with identifier: EZ84220
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41d0992-9d34-59cf-8948-446e95d883fd with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_25fa539d522699cd02eafe07b0e561f6.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cde574ca-85e0-53e1-9c06-c4c24764a344 with identifier: PP81137
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde574ca-85e0-53e1-9c06-c4c24764a344 with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f0dcfd5c6c7cbc7e107198e74bf7110f.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24e36cb5-1e5a-5368-a409-4502811b3368 with identifier: BS51992
2026-04-27 07:56:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24e36cb5-1e5a-5368-a409-4502811b3368 with scrape type 1
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_c9979b80f600850502ddaa117ba8eced.jpg not downloaded yet
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_3013d83d58aea32fb714c9de4ac6232b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_35e326e32a00a6c59b1e91190a27c908.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a9186bb5b271e7722034b931d31b6438.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_149c902b1a43cc7d5bdf6ed6d6f03a47.jpg not downloaded yet
2026-04-27 07:56:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with identifier: XZ72452
2026-04-27 07:56:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with identifier: XZ72452
2026-04-27 07:56:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b with identifier: XZ72452 to the API
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_aff790d185bb08a904c5ff4fb5b824c9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:34:08Z',
'fuel_type': 'diesel',
'id': 'bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XZ72452',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 119463,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113225,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5070232d17681db49ce19528c803f4cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_8e552974293fec67c6818c97c880f6c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_3dd63f6fcf7adf5e0be53fe82dd515e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_5cb29d2b894805afa11e09a64976fac7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_bcdde55157d68b1b156d9fc47408c516.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_9d64aad3c448a370b0a09f699493c835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_a670f3a6e2b457c5995be79ee720f12b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_2f3e85f27d80b133c195a788530a64e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_aff790d185bb08a904c5ff4fb5b824c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b/bbe69eb5-6d72-5425-ae0a-01bd99c9ce8b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/93/d39359b6eeaca3ef4019d07dfa33ae57/pa/XZ72452_94641f0bb179378abe85f311751be5a6.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-04-07',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Business',
'transmission': 'automatic',
'trim': 'Business',
'year': 2019}
2026-04-27 07:56:10 [auto1.it] INFO: Saving data for XZ72452: {'created_time': 1777276570.305751, 'last_price_update_time': 1777276570.305763, 'has_photos': True, 'auction_closing_time': 1777390448.0}
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_59d680085bcb64fda1a881f5aaaa8096.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_78b1bc8efe5b3263302b4a054efb3df7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_36788ba3d7a6aeacd9186910fe1a37e0.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_392cb1e70bed8222255a92fdbb869f5b.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_7ff5a4dccd608f34d448f06b3741eb1e.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f27cf1bd1c697d2626424ded43a313e3.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_5dbac5675085f0b67519203d8448c4de.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a3009543c2a03d0035cdc6a00dab2733.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.extensions.logstats] INFO: Crawled 224 pages (at 135 pages/min), scraped 59 items (at 32 items/min)
2026-04-27 07:56:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_ef08e2e409d5377386d662d8766db81c.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_7576f82a1da8f8f92f103e9544c9c61c.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB21565> (referer: https://www.auto1.com/v1/car-details-view/VB21565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63ba5d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_788d4468429f0459e6357ad5f3894846.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5969a90>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4cfda0c811ef06366bc9e715b42b6070.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ad890>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_b11e8a86b32b80d8dd8dbeef982c2c60.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55423d0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_883fca8483ca0e717023e52fd90001c1.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ad090>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_b9f50fde06298274912637180056c4c7.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_17a5529a1880b64dc9dc486a46b9b390.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_a577e7acf4eb92e1310278202726194d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_3e86bbb69a16d0630552a4363fe1a7a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_7c00d0893299287d581d320644907b6d.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_52153b20c1987b7eb170e5cc596f7d7a.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_266f6b8cf761fbb5c8ffe00b613e5cd6.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_488d7a29ebe02fdb4a0843ae62844944.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_b13f359439ec874930a113a55b620bbb.jpg not downloaded yet
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_2ddfb7b2df14dfe97e9811a5938897a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_08aa639a917125ca5630f43ab8bdf520.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_37ba7874c47341bab5c0978fcd4c2928.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_807daa9abf11f321c3e84564ff6a6e60.jpg not downloaded yet
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55daed0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_3013d83d58aea32fb714c9de4ac6232b.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5890>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_35e326e32a00a6c59b1e91190a27c908.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_d5d394f05310538e14bceb4708a0a983.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_b0cf0cae3ba992252d4f71d8d01e8e0f.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_19c64923c71e7cb0598f8e46274ea1c7.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_205fcf41805b8a665e7b3fdbdfd28dbc.jpg not downloaded yet
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_412b2b84848a19b12b446216888c3679.jpg not downloaded yet
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5331a10>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_59d680085bcb64fda1a881f5aaaa8096.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5515ad0>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_78b1bc8efe5b3263302b4a054efb3df7.jpg saved to cache
2026-04-27 07:56:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e1e50>
2026-04-27 07:56:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a3009543c2a03d0035cdc6a00dab2733.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4533258-9b61-5357-8077-84cdcd92b92c with identifier: VB21565
2026-04-27 07:56:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4533258-9b61-5357-8077-84cdcd92b92c with scrape type 1
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_3c8041f0a87631598afce4f89f5ce32a.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_68446866a1f6e3d69578b2201b7f1835.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_874a16d81f12cabfa338dd6495f766a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_b0f6b120bc6752ac555a0ac92199bdc7.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_033130c9a9da09245f8db87ed1eb6507.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_491193019282e22fc3a51d6acd530786.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_33442ff0705e2e8c4f885ff262e2d356.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4255ac127aa1ce415eedc17d4b456985.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_30dda184a403893c997edadde0db4dc0.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_7a6fd15fd2148dd40ca908454a34d6bd.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_27586c9f4d8497b45698bcda2d770716.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6368250>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_17a5529a1880b64dc9dc486a46b9b390.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5963210>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_a577e7acf4eb92e1310278202726194d.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6569a10>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_3e86bbb69a16d0630552a4363fe1a7a0.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57db850>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_2ddfb7b2df14dfe97e9811a5938897a5.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557c750>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_08aa639a917125ca5630f43ab8bdf520.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_f34400e9083ae54f8006d2781ecdbc1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a9186bb5b271e7722034b931d31b6438.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_5e7ce2bd6e781dcd1cc37c8f12e7e65b.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e801e2a2439b25da1dd0778056892521.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_b209ecb84121efe7eaac38ff3769cb4b.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_2d92597cd5fe139709203b58e6fd0bdc.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_84b38f7bed9e83cfa871c2b340d3062c.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632ebd0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_68446866a1f6e3d69578b2201b7f1835.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5325350>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_874a16d81f12cabfa338dd6495f766a0.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f4e10>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_491193019282e22fc3a51d6acd530786.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57d7690>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_33442ff0705e2e8c4f885ff262e2d356.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_5dbac5675085f0b67519203d8448c4de.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_c9979b80f600850502ddaa117ba8eced.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_a7c968d308d63f3ce92f9680d14c636b.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_9da8d87332a4cdd85bfe294dcb8026d4.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_4e75c6522f15e84adb0a4061a4ff62f9.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_7ff5a4dccd608f34d448f06b3741eb1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_392cb1e70bed8222255a92fdbb869f5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f27cf1bd1c697d2626424ded43a313e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_67333b3fd75fa79ea576d0f2adef5bbf.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_04061db66b88373e194a62927760dc62.jpg not downloaded yet
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f0710>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_f34400e9083ae54f8006d2781ecdbc1e.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f8b90>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a9186bb5b271e7722034b931d31b6438.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_ef08e2e409d5377386d662d8766db81c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e4eb9ca7d365c6993c67a1d903d089b7.jpg not downloaded yet
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_d31540fc477b4859a9c68bc77b6d5d58.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_aed7212db3f095912a170802e75fc4be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_3c8041f0a87631598afce4f89f5ce32a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4d494d0432a6a3b8b86af5a45bddbe91.jpg not downloaded yet
2026-04-27 07:56:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_149c902b1a43cc7d5bdf6ed6d6f03a47.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5961dd0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_5dbac5675085f0b67519203d8448c4de.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6348b50>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_c9979b80f600850502ddaa117ba8eced.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53276d0>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_7ff5a4dccd608f34d448f06b3741eb1e.jpg saved to cache
2026-04-27 07:56:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5575390>
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_392cb1e70bed8222255a92fdbb869f5b.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57da510>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f27cf1bd1c697d2626424ded43a313e3.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_b0f6b120bc6752ac555a0ac92199bdc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_412b2b84848a19b12b446216888c3679.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_19c64923c71e7cb0598f8e46274ea1c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_205fcf41805b8a665e7b3fdbdfd28dbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_2d92597cd5fe139709203b58e6fd0bdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56553d0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_ef08e2e409d5377386d662d8766db81c.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cf810>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_aed7212db3f095912a170802e75fc4be.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af7090>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_3c8041f0a87631598afce4f89f5ce32a.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6581450>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_149c902b1a43cc7d5bdf6ed6d6f03a47.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_7576f82a1da8f8f92f103e9544c9c61c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_b209ecb84121efe7eaac38ff3769cb4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56276d0>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_b0f6b120bc6752ac555a0ac92199bdc7.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55dab90>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_412b2b84848a19b12b446216888c3679.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5493990>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_19c64923c71e7cb0598f8e46274ea1c7.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55db790>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_205fcf41805b8a665e7b3fdbdfd28dbc.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5343390>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_2d92597cd5fe139709203b58e6fd0bdc.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_a7c968d308d63f3ce92f9680d14c636b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_04061db66b88373e194a62927760dc62.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_67333b3fd75fa79ea576d0f2adef5bbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VP82069/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b3490>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_7576f82a1da8f8f92f103e9544c9c61c.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3790>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_b209ecb84121efe7eaac38ff3769cb4b.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_9da8d87332a4cdd85bfe294dcb8026d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_84b38f7bed9e83cfa871c2b340d3062c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_d31540fc477b4859a9c68bc77b6d5d58.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_033130c9a9da09245f8db87ed1eb6507.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bde50>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_a7c968d308d63f3ce92f9680d14c636b.jpg saved to cache
2026-04-27 07:56:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580ed10>
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_04061db66b88373e194a62927760dc62.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59be910>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_67333b3fd75fa79ea576d0f2adef5bbf.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_5e7ce2bd6e781dcd1cc37c8f12e7e65b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4d494d0432a6a3b8b86af5a45bddbe91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64440d0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_9da8d87332a4cdd85bfe294dcb8026d4.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5655ad0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_84b38f7bed9e83cfa871c2b340d3062c.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533bbd0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_d31540fc477b4859a9c68bc77b6d5d58.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5338a90>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_033130c9a9da09245f8db87ed1eb6507.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_7a6fd15fd2148dd40ca908454a34d6bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_30dda184a403893c997edadde0db4dc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_27586c9f4d8497b45698bcda2d770716.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4255ac127aa1ce415eedc17d4b456985.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead569a010>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_5e7ce2bd6e781dcd1cc37c8f12e7e65b.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c7750>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4d494d0432a6a3b8b86af5a45bddbe91.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e4eb9ca7d365c6993c67a1d903d089b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e801e2a2439b25da1dd0778056892521.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5454a90>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_7a6fd15fd2148dd40ca908454a34d6bd.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_d5d394f05310538e14bceb4708a0a983.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_b13f359439ec874930a113a55b620bbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5633f90>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_30dda184a403893c997edadde0db4dc0.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6593ed0>
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_27586c9f4d8497b45698bcda2d770716.jpg saved to cache
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4533258-9b61-5357-8077-84cdcd92b92c
2026-04-27 07:56:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4533258-9b61-5357-8077-84cdcd92b92c, skipping ID generation
2026-04-27 07:56:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4533258-9b61-5357-8077-84cdcd92b92c with scrape type 1
2026-04-27 07:56:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4533258-9b61-5357-8077-84cdcd92b92c sending to next pipeline
2026-04-27 07:56:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a4533258-9b61-5357-8077-84cdcd92b92c, identifier: VB21565
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5594990>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4255ac127aa1ce415eedc17d4b456985.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a4533258-9b61-5357-8077-84cdcd92b92c with identifier: VB21565
2026-04-27 07:56:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a4533258-9b61-5357-8077-84cdcd92b92c with identifier: VB21565
2026-04-27 07:56:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a4533258-9b61-5357-8077-84cdcd92b92c with identifier: VB21565 to the API
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_27586c9f4d8497b45698bcda2d770716.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:52:50Z',
'fuel_type': 'diesel',
'id': 'a4533258-9b61-5357-8077-84cdcd92b92c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB21565',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Nissan',
'model': 'Note',
'odometer': 144355,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_3c8041f0a87631598afce4f89f5ce32a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_27586c9f4d8497b45698bcda2d770716.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_2d92597cd5fe139709203b58e6fd0bdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75156,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_9da8d87332a4cdd85bfe294dcb8026d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a4533258-9b61-5357-8077-84cdcd92b92c/a4533258-9b61-5357-8077-84cdcd92b92c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/0b/890b29b059c4b4ab1e61e38c8fff5819/pa/VB21565_04061db66b88373e194a62927760dc62.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2015-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Note 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2015}
2026-04-27 07:56:14 [auto1.it] INFO: Saving data for VB21565: {'created_time': 1777276574.798991, 'last_price_update_time': 1777276574.799003, 'has_photos': True, 'auction_closing_time': 1777391570.0}
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_b0cf0cae3ba992252d4f71d8d01e8e0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_488d7a29ebe02fdb4a0843ae62844944.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_266f6b8cf761fbb5c8ffe00b613e5cd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_37ba7874c47341bab5c0978fcd4c2928.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VP82069> (referer: https://www.auto1.com/v1/car-details-view/VP82069/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_7c00d0893299287d581d320644907b6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_52153b20c1987b7eb170e5cc596f7d7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:04:24 16:32:41\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-04-27 07:56:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6483890>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e4eb9ca7d365c6993c67a1d903d089b7.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a1a50>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e801e2a2439b25da1dd0778056892521.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760790>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_d5d394f05310538e14bceb4708a0a983.jpg saved to cache
2026-04-27 07:56:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c0950>
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_b13f359439ec874930a113a55b620bbb.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24e36cb5-1e5a-5368-a409-4502811b3368
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24e36cb5-1e5a-5368-a409-4502811b3368, skipping ID generation
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24e36cb5-1e5a-5368-a409-4502811b3368 with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24e36cb5-1e5a-5368-a409-4502811b3368 sending to next pipeline
2026-04-27 07:56:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 24e36cb5-1e5a-5368-a409-4502811b3368, identifier: BS51992
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_4e75c6522f15e84adb0a4061a4ff62f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 24e36cb5-1e5a-5368-a409-4502811b3368 with identifier: BS51992
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-04-27 07:56:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:56:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 24e36cb5-1e5a-5368-a409-4502811b3368 with identifier: BS51992
2026-04-27 07:56:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 24e36cb5-1e5a-5368-a409-4502811b3368 with identifier: BS51992 to the API
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_b13f359439ec874930a113a55b620bbb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Padova',
'color': 'violet',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:57:55Z',
'fuel_type': 'petrol',
'id': '24e36cb5-1e5a-5368-a409-4502811b3368',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS51992',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Ford',
'model': 'Ka',
'odometer': 116426,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_c9979b80f600850502ddaa117ba8eced.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87402,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_5dbac5675085f0b67519203d8448c4de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_b13f359439ec874930a113a55b620bbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_412b2b84848a19b12b446216888c3679.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_24e36cb5-1e5a-5368-a409-4502811b3368/24e36cb5-1e5a-5368-a409-4502811b3368_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/19/9b1957e381e7c45af2b65bed85186190/pa/BS51992_7a6fd15fd2148dd40ca908454a34d6bd.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2009-08-31',
'seats_number': 4,
'seller_name': None,
'title': 'Ford Ka 1.2 Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2009}
2026-04-27 07:56:15 [auto1.it] INFO: Saving data for BS51992: {'created_time': 1777276575.687101, 'last_price_update_time': 1777276575.68711, 'has_photos': True, 'auction_closing_time': 1777391875.0}
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_122b6058264558f8609c5f8e0e821cd2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_36788ba3d7a6aeacd9186910fe1a37e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4fed390>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_b0cf0cae3ba992252d4f71d8d01e8e0f.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5490310>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_488d7a29ebe02fdb4a0843ae62844944.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6337dd0>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_266f6b8cf761fbb5c8ffe00b613e5cd6.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642c950>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_37ba7874c47341bab5c0978fcd4c2928.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0f6db3-2704-55ad-95fe-b59d07aaa25b with identifier: VP82069
2026-04-27 07:56:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b with scrape type 1
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_f8fd7f087000ebdbf6ae027dbd8843cb.jpg not downloaded yet
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513710>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_7c00d0893299287d581d320644907b6d.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a02110>
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_52153b20c1987b7eb170e5cc596f7d7a.jpg saved to cache
2026-04-27 07:56:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f0dcfd5c6c7cbc7e107198e74bf7110f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_25fa539d522699cd02eafe07b0e561f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_065415d5c40906e5e2c91ac12ef8252a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_69964037ce9c64b32bfac31bbdf06420.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_7df2b39a40a416a9e59657ded017b8a1.jpg not downloaded yet
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Make (271) - type: string (2) Tag Location: 22 - Data Location: 134 - value: b'NIKON CORPORATION\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Model (272) - type: string (2) Tag Location: 34 - Data Location: 152 - value: b'NIKON D810\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 164 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 172 - value: b',\x01\x00\x00\x01\x00\x00\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Software (305) - type: string (2) Tag Location: 82 - Data Location: 180 - value: <table: 44 bytes>
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: DateTime (306) - type: string (2) Tag Location: 94 - Data Location: 224 - value: b'2026:04:24 16:32:39\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Artist (315) - type: string (2) Tag Location: 106 - Data Location: 244 - value: b'Federico Ambrogio Rosa\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: Copyright (33432) - type: string (2) Tag Location: 118 - Data Location: 268 - value: b'Federico Ambrogio Rosa\x00'
2026-04-27 07:56:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'$\x01\x00\x00'
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead592d190>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_4e75c6522f15e84adb0a4061a4ff62f9.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_807daa9abf11f321c3e84564ff6a6e60.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_1114b615fd253be59c646b968a500a01.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63fb710>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_122b6058264558f8609c5f8e0e821cd2.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553d290>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_36788ba3d7a6aeacd9186910fe1a37e0.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_21afae67c1727d9a054e7e07a5a87e00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6fefa8268c26c4499c9bf22fdda269e9.jpg not downloaded yet
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_6f1fcdef85ffdd96a7ff8f586d607e96.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4d10df41af9ab477bcb7cb2762546f30.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_947519589b3d295f8cfe1c3db52839ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_b1496b95d9af2ef77d960ec94e954da9.jpg not downloaded yet
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead543c950>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f0dcfd5c6c7cbc7e107198e74bf7110f.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cde574ca-85e0-53e1-9c06-c4c24764a344
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cde574ca-85e0-53e1-9c06-c4c24764a344, skipping ID generation
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cde574ca-85e0-53e1-9c06-c4c24764a344 with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cde574ca-85e0-53e1-9c06-c4c24764a344 sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cde574ca-85e0-53e1-9c06-c4c24764a344, identifier: PP81137
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a4aa10>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_25fa539d522699cd02eafe07b0e561f6.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a41d0992-9d34-59cf-8948-446e95d883fd
2026-04-27 07:56:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a41d0992-9d34-59cf-8948-446e95d883fd, skipping ID generation
2026-04-27 07:56:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41d0992-9d34-59cf-8948-446e95d883fd with scrape type 1
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a41d0992-9d34-59cf-8948-446e95d883fd sending to next pipeline
2026-04-27 07:56:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a41d0992-9d34-59cf-8948-446e95d883fd, identifier: EZ84220
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553f990>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_065415d5c40906e5e2c91ac12ef8252a.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f51d0>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_69964037ce9c64b32bfac31bbdf06420.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553e410>
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_807daa9abf11f321c3e84564ff6a6e60.jpg saved to cache
2026-04-27 07:56:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cde574ca-85e0-53e1-9c06-c4c24764a344 with identifier: PP81137
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:56:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-04-27 07:56:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cde574ca-85e0-53e1-9c06-c4c24764a344 with identifier: PP81137
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cde574ca-85e0-53e1-9c06-c4c24764a344 with identifier: PP81137 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f0dcfd5c6c7cbc7e107198e74bf7110f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Varedo',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:32:01Z',
'fuel_type': 'gas',
'id': 'cde574ca-85e0-53e1-9c06-c4c24764a344',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP81137',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Fiat',
'model': 'Bravo',
'odometer': 189246,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f0dcfd5c6c7cbc7e107198e74bf7110f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_f27cf1bd1c697d2626424ded43a313e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_488d7a29ebe02fdb4a0843ae62844944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_205fcf41805b8a665e7b3fdbdfd28dbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cde574ca-85e0-53e1-9c06-c4c24764a344/cde574ca-85e0-53e1-9c06-c4c24764a344_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/09/33092660bb079593048d25ef75a4b4eb/pa/PP81137_30dda184a403893c997edadde0db4dc0.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2009-05-27',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Bravo 1.4 LPG Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2009}
2026-04-27 07:56:17 [auto1.it] INFO: Saving data for PP81137: {'created_time': 1777276577.787741, 'last_price_update_time': 1777276577.787754, 'has_photos': True, 'auction_closing_time': 1777390321.0}
2026-04-27 07:56:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a41d0992-9d34-59cf-8948-446e95d883fd with identifier: EZ84220
2026-04-27 07:56:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a41d0992-9d34-59cf-8948-446e95d883fd with identifier: EZ84220
2026-04-27 07:56:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a41d0992-9d34-59cf-8948-446e95d883fd with identifier: EZ84220 to the API
2026-04-27 07:56:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_25fa539d522699cd02eafe07b0e561f6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Roma',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:36:33Z',
'fuel_type': 'diesel',
'id': 'a41d0992-9d34-59cf-8948-446e95d883fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ84220',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Seat',
'model': 'Tarraco',
'odometer': 74862,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_25fa539d522699cd02eafe07b0e561f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_7ff5a4dccd608f34d448f06b3741eb1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_266f6b8cf761fbb5c8ffe00b613e5cd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_19c64923c71e7cb0598f8e46274ea1c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76792,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4255ac127aa1ce415eedc17d4b456985.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_b209ecb84121efe7eaac38ff3769cb4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_a7c968d308d63f3ce92f9680d14c636b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_67333b3fd75fa79ea576d0f2adef5bbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74593,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_d31540fc477b4859a9c68bc77b6d5d58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a41d0992-9d34-59cf-8948-446e95d883fd/a41d0992-9d34-59cf-8948-446e95d883fd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/66/a466f2814b0065ad7dc186a41e1509e8/pa/EZ84220_4d494d0432a6a3b8b86af5a45bddbe91.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2021-05-20',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2021}
2026-04-27 07:56:18 [auto1.it] INFO: Saving data for EZ84220: {'created_time': 1777276578.200973, 'last_price_update_time': 1777276578.200986, 'has_photos': True, 'auction_closing_time': 1777390593.0}
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d93832f3ade4a2847e3e595178f82178.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_9cf1c64a91224bf784378b0aeab3e090.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_4b57e94f14e9368f35b9b8cd169d94d8.jpg not downloaded yet
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_42055db8e9cc67000e0eadb1e7a79ef9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_8110dbf7210277bf4229df96b6ad0ad4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_f8fd7f087000ebdbf6ae027dbd8843cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_5db36d09efafc39927e4555085a1c544.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_c31a81d6417ce247c43262fb26eaeeb0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_ebc6fcc40e881d20d6942a9528178f04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_de7651de6c350bf1d1da538ecc2bd7e6.jpg not downloaded yet
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659f0d0>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_21afae67c1727d9a054e7e07a5a87e00.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e1a4eed-5add-51ec-92ad-ade54622b49c
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e1a4eed-5add-51ec-92ad-ade54622b49c, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e1a4eed-5add-51ec-92ad-ade54622b49c with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e1a4eed-5add-51ec-92ad-ade54622b49c sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6e1a4eed-5add-51ec-92ad-ade54622b49c, identifier: XF01774
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593f6d0>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_6f1fcdef85ffdd96a7ff8f586d607e96.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b2d90>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4d10df41af9ab477bcb7cb2762546f30.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e72306b9-84e5-5092-a509-09187cf2419f
2026-04-27 07:56:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e72306b9-84e5-5092-a509-09187cf2419f, skipping ID generation
2026-04-27 07:56:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72306b9-84e5-5092-a509-09187cf2419f with scrape type 1
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e72306b9-84e5-5092-a509-09187cf2419f sending to next pipeline
2026-04-27 07:56:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e72306b9-84e5-5092-a509-09187cf2419f, identifier: DR60838
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fd810>
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_947519589b3d295f8cfe1c3db52839ad.jpg saved to cache
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_c5a819bd392cd6496e3215db1db12b3a.jpg not downloaded yet
2026-04-27 07:56:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6e1a4eed-5add-51ec-92ad-ade54622b49c with identifier: XF01774
2026-04-27 07:56:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6e1a4eed-5add-51ec-92ad-ade54622b49c with identifier: XF01774
2026-04-27 07:56:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6e1a4eed-5add-51ec-92ad-ade54622b49c with identifier: XF01774 to the API
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_21afae67c1727d9a054e7e07a5a87e00.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'city': 'Milano',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:37:12Z',
'fuel_type': 'diesel',
'id': '6e1a4eed-5add-51ec-92ad-ade54622b49c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF01774',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Ford',
'model': 'Kuga',
'odometer': 95580,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_3013d83d58aea32fb714c9de4ac6232b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69158,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a3009543c2a03d0035cdc6a00dab2733.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_78b1bc8efe5b3263302b4a054efb3df7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_21afae67c1727d9a054e7e07a5a87e00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_68446866a1f6e3d69578b2201b7f1835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_a9186bb5b271e7722034b931d31b6438.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_ef08e2e409d5377386d662d8766db81c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_37ba7874c47341bab5c0978fcd4c2928.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_b0f6b120bc6752ac555a0ac92199bdc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6e1a4eed-5add-51ec-92ad-ade54622b49c/6e1a4eed-5add-51ec-92ad-ade54622b49c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/73/db735fca58837954ddd8948f28520015/pa/XF01774_5e7ce2bd6e781dcd1cc37c8f12e7e65b.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2014-03-02',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2014}
2026-04-27 07:56:19 [auto1.it] INFO: Saving data for XF01774: {'created_time': 1777276579.066481, 'last_price_update_time': 1777276579.066495, 'has_photos': True, 'auction_closing_time': 1777390632.0}
2026-04-27 07:56:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e72306b9-84e5-5092-a509-09187cf2419f with identifier: DR60838
2026-04-27 07:56:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e72306b9-84e5-5092-a509-09187cf2419f with identifier: DR60838
2026-04-27 07:56:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e72306b9-84e5-5092-a509-09187cf2419f with identifier: DR60838 to the API
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4d10df41af9ab477bcb7cb2762546f30.jpg>
{'auction_title': '',
'c_o_2_emission_value': 183,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:22:17Z',
'fuel_type': 'diesel',
'id': 'e72306b9-84e5-5092-a509-09187cf2419f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR60838',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'BMW',
'model': 'X6',
'odometer': 134647,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94441,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4cfda0c811ef06366bc9e715b42b6070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_4d10df41af9ab477bcb7cb2762546f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_b9f50fde06298274912637180056c4c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_33442ff0705e2e8c4f885ff262e2d356.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_08aa639a917125ca5630f43ab8bdf520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_491193019282e22fc3a51d6acd530786.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_69964037ce9c64b32bfac31bbdf06420.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_36788ba3d7a6aeacd9186910fe1a37e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_7c00d0893299287d581d320644907b6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e72306b9-84e5-5092-a509-09187cf2419f/e72306b9-84e5-5092-a509-09187cf2419f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/de/bede28fded89b69ddb2f7efc83b826a2/pa/DR60838_d5d394f05310538e14bceb4708a0a983.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2018-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X6 xDrive 30d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-04-27 07:56:19 [auto1.it] INFO: Saving data for DR60838: {'created_time': 1777276579.487097, 'last_price_update_time': 1777276579.487124, 'has_photos': True, 'auction_closing_time': 1777389737.0}
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_7df2b39a40a416a9e59657ded017b8a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6fefa8268c26c4499c9bf22fdda269e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_eb73b79843afb2f06b88c3a55cc5b00a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_71ba40c74750984d15a3a837336574cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_ebb46ca6122e21f8e94752de3d0ec37d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_1114b615fd253be59c646b968a500a01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cc4c52ded9c105eefa7c829bab529bf5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_595969b6f47f84143c968cfe47dd9618.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6c5148fe05d8f208f5da37162067bea3.jpg not downloaded yet
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed610>
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d93832f3ade4a2847e3e595178f82178.jpg saved to cache
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6
2026-04-27 07:56:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed013b0a-7f64-57ae-805e-ae496dc6ffd6, skipping ID generation
2026-04-27 07:56:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with scrape type 1
2026-04-27 07:56:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed013b0a-7f64-57ae-805e-ae496dc6ffd6 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ed013b0a-7f64-57ae-805e-ae496dc6ffd6, identifier: TU31617
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6337350>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_9cf1c64a91224bf784378b0aeab3e090.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e397173d-23c1-5766-863a-b6686a08b79b
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e397173d-23c1-5766-863a-b6686a08b79b, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e397173d-23c1-5766-863a-b6686a08b79b with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e397173d-23c1-5766-863a-b6686a08b79b sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e397173d-23c1-5766-863a-b6686a08b79b, identifier: XL05283
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665cd0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_42055db8e9cc67000e0eadb1e7a79ef9.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e, identifier: DN95264
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5485ed0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_8110dbf7210277bf4229df96b6ad0ad4.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bfdff570-5a03-5637-a870-fa2394aefb54
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bfdff570-5a03-5637-a870-fa2394aefb54, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bfdff570-5a03-5637-a870-fa2394aefb54 with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bfdff570-5a03-5637-a870-fa2394aefb54 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bfdff570-5a03-5637-a870-fa2394aefb54, identifier: PN84463
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545d990>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_f8fd7f087000ebdbf6ae027dbd8843cb.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545b3d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_5db36d09efafc39927e4555085a1c544.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa6a7c94-79e4-5d68-ac94-a8583baa1fef, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa6a7c94-79e4-5d68-ac94-a8583baa1fef sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa6a7c94-79e4-5d68-ac94-a8583baa1fef, identifier: YV30148
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5342950>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_c31a81d6417ce247c43262fb26eaeeb0.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 43018d47-f67c-580c-bdff-dc896cf4ced3
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 43018d47-f67c-580c-bdff-dc896cf4ced3, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43018d47-f67c-580c-bdff-dc896cf4ced3 with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 43018d47-f67c-580c-bdff-dc896cf4ced3 sending to next pipeline
2026-04-27 07:56:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 43018d47-f67c-580c-bdff-dc896cf4ced3, identifier: SW25122
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58af4d0>
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_ebc6fcc40e881d20d6942a9528178f04.jpg saved to cache
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec
2026-04-27 07:56:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a649dd0a-fc9c-5db9-9b65-624bda30f0ec, skipping ID generation
2026-04-27 07:56:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec with scrape type 1
2026-04-27 07:56:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a649dd0a-fc9c-5db9-9b65-624bda30f0ec sending to next pipeline
2026-04-27 07:56:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a649dd0a-fc9c-5db9-9b65-624bda30f0ec, identifier: XJ02099
2026-04-27 07:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with identifier: TU31617
2026-04-27 07:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with identifier: TU31617
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ed013b0a-7f64-57ae-805e-ae496dc6ffd6 with identifier: TU31617 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d93832f3ade4a2847e3e595178f82178.jpg>
{'auction_title': '',
'c_o_2_emission_value': 194,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '3.0L',
'engine_horse_power': 250,
'expiration_date': '2026-04-28T15:23:23Z',
'fuel_type': 'diesel',
'id': 'ed013b0a-7f64-57ae-805e-ae496dc6ffd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU31617',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 243851,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_b209540acede3a4a113b7433b1e050a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_7c1d8ef78400eb4c67db55a8898a0b66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d6e2f268ae41ec2213dc4a5d5a67cad1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70801,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_d93832f3ade4a2847e3e595178f82178.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_947519589b3d295f8cfe1c3db52839ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67699,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_35e326e32a00a6c59b1e91190a27c908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_6f1fcdef85ffdd96a7ff8f586d607e96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_2ddfb7b2df14dfe97e9811a5938897a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_f34400e9083ae54f8006d2781ecdbc1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ed013b0a-7f64-57ae-805e-ae496dc6ffd6/ed013b0a-7f64-57ae-805e-ae496dc6ffd6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4d/d0/4dd0f5fec7a9c21279a2562375f9556f/pa/TU31617_065415d5c40906e5e2c91ac12ef8252a.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2014-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 V6 TDI HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2014}
2026-04-27 07:56:21 [auto1.it] INFO: Saving data for TU31617: {'created_time': 1777276581.465709, 'last_price_update_time': 1777276581.465721, 'has_photos': True, 'auction_closing_time': 1777389803.0}
2026-04-27 07:56:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e397173d-23c1-5766-863a-b6686a08b79b with identifier: XL05283
2026-04-27 07:56:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e397173d-23c1-5766-863a-b6686a08b79b with identifier: XL05283
2026-04-27 07:56:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e397173d-23c1-5766-863a-b6686a08b79b with identifier: XL05283 to the API
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_9cf1c64a91224bf784378b0aeab3e090.jpg>
{'auction_title': '',
'c_o_2_emission_value': 171,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 240,
'expiration_date': '2026-04-28T15:22:21Z',
'fuel_type': 'diesel',
'id': 'e397173d-23c1-5766-863a-b6686a08b79b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XL05283',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Land Rover',
'model': 'Discovery 5',
'odometer': 83481,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_386c1ebfa164555653b1d489e7bf4ba0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_9cf1c64a91224bf784378b0aeab3e090.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_883fca8483ca0e717023e52fd90001c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47992,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_59d680085bcb64fda1a881f5aaaa8096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_a577e7acf4eb92e1310278202726194d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_874a16d81f12cabfa338dd6495f766a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_122b6058264558f8609c5f8e0e821cd2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_392cb1e70bed8222255a92fdbb869f5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_52153b20c1987b7eb170e5cc596f7d7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e397173d-23c1-5766-863a-b6686a08b79b/e397173d-23c1-5766-863a-b6686a08b79b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/ec/e6ec75158cabb3337d8288f1212405ac/pa/XL05283_b0cf0cae3ba992252d4f71d8d01e8e0f.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2018-04-26',
'seats_number': 7,
'seller_name': None,
'title': 'Land Rover Discovery 5 2.0 TD Sd4 SD4 SE',
'transmission': 'automatic',
'trim': 'SD4 SE',
'year': 2018}
2026-04-27 07:56:22 [auto1.it] INFO: Saving data for XL05283: {'created_time': 1777276582.058581, 'last_price_update_time': 1777276582.058593, 'has_photos': True, 'auction_closing_time': 1777389741.0}
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with identifier: DN95264
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with identifier: DN95264
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e with identifier: DN95264 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_42055db8e9cc67000e0eadb1e7a79ef9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 171,
'category': None,
'city': 'Senago',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 174,
'expiration_date': '2026-04-28T15:03:41Z',
'fuel_type': 'petrol',
'id': '096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN95264',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'EVO',
'model': '7',
'odometer': 33341,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_42055db8e9cc67000e0eadb1e7a79ef9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_087ebdd80166ebfb519c8d4bcefff065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_849495a0fa0897a224d17f710408d049.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_ca77fd8c91a559ce50e9fa6a8437d04e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_31eebf2d33bc32befb8024e342ccb935.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_fa1acd44623466c34b4f3a843247c815.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_6864d87fa68106fda0fca77f91d516e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_d13f3239436b4c1660122966a9eb019f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_0721a38fe1d832f81c64270e13364f30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e/096aa9e7-f9d1-5cdd-8bb3-4f15f1dfd03e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57515,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/ed/61ed6642694e2831a74c353eed72d510/pa/DN95264_b8308c8caeb480026c509568f423f3df.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2023-10-09',
'seats_number': 6,
'seller_name': None,
'title': 'EVO 7 1.5',
'transmission': 'automatic',
'trim': '',
'year': 2023}
2026-04-27 07:56:22 [auto1.it] INFO: Saving data for DN95264: {'created_time': 1777276582.465308, 'last_price_update_time': 1777276582.46532, 'has_photos': True, 'auction_closing_time': 1777388621.0}
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bfdff570-5a03-5637-a870-fa2394aefb54 with identifier: PN84463
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bfdff570-5a03-5637-a870-fa2394aefb54 with identifier: PN84463
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bfdff570-5a03-5637-a870-fa2394aefb54 with identifier: PN84463 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_8110dbf7210277bf4229df96b6ad0ad4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Creazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:27:30Z',
'fuel_type': 'diesel',
'id': 'bfdff570-5a03-5637-a870-fa2394aefb54',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5315,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN84463',
'listing': 'auction',
'location': 'IT, Creazzo VI',
'location_confidence': 'geocoded',
'longitude': 11.4779,
'make': 'Jeep',
'model': 'Renegade',
'odometer': 215074,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_59ffa0e16a98ff0b86dc7ebdbe3fba85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0b666df5b60828d82c559fc08cd5a484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d9de451a0b82ccd0e7f52974bc83e575.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58524,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_d2d856def4089ef4fe4a646ef32f1cdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68919,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_0f18404ea90d9bad7992269ef2e44949.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_e9659387dc762dd308c3af685396dda2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_9e119586a6d71912e00aabfff518517b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_10c1dab0b485f741982312ff21ada9bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_f423f5fa1be0363c28e7547445bca66a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bfdff570-5a03-5637-a870-fa2394aefb54/bfdff570-5a03-5637-a870-fa2394aefb54_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/0e/8f0e690edbfae7da084febe01530b2cc/pa/PN84463_8110dbf7210277bf4229df96b6ad0ad4.jpg',
'Width': 800}],
'postal_code': '36051',
'price': 0,
'price_includes_vat': True,
'province': 'Vicenza',
'province_code': 'IT-VI',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2015-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'manual',
'trim': 'Limited FWD',
'year': 2015}
2026-04-27 07:56:22 [auto1.it] INFO: Saving data for PN84463: {'created_time': 1777276582.857683, 'last_price_update_time': 1777276582.857696, 'has_photos': True, 'auction_closing_time': 1777390050.0}
2026-04-27 07:56:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-04-27 07:56:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148
2026-04-27 07:56:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa6a7c94-79e4-5d68-ac94-a8583baa1fef with identifier: YV30148 to the API
2026-04-27 07:56:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_5db36d09efafc39927e4555085a1c544.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Roma',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-04-28T15:58:18Z',
'fuel_type': 'diesel',
'id': 'aa6a7c94-79e4-5d68-ac94-a8583baa1fef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YV30148',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Peugeot',
'model': '2008',
'odometer': 215397,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_788d4468429f0459e6357ad5f3894846.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_5db36d09efafc39927e4555085a1c544.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_b11e8a86b32b80d8dd8dbeef982c2c60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97405,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_3e86bbb69a16d0630552a4363fe1a7a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa6a7c94-79e4-5d68-ac94-a8583baa1fef/aa6a7c94-79e4-5d68-ac94-a8583baa1fef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img28/da/28da5cf6fa1cbf177a172beea6b71455/pa/YV30148_17a5529a1880b64dc9dc486a46b9b390.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2014-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 e-HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2014}
2026-04-27 07:56:23 [auto1.it] INFO: Saving data for YV30148: {'created_time': 1777276583.445481, 'last_price_update_time': 1777276583.445495, 'has_photos': True, 'auction_closing_time': 1777391898.0}
2026-04-27 07:56:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 43018d47-f67c-580c-bdff-dc896cf4ced3 with identifier: SW25122
2026-04-27 07:56:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 43018d47-f67c-580c-bdff-dc896cf4ced3 with identifier: SW25122
2026-04-27 07:56:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 43018d47-f67c-580c-bdff-dc896cf4ced3 with identifier: SW25122 to the API
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_c31a81d6417ce247c43262fb26eaeeb0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:14:19Z',
'fuel_type': 'petrol',
'id': '43018d47-f67c-580c-bdff-dc896cf4ced3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW25122',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 200472,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_b208ace24d1dd1cad1eaace85c4b83f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_c31a81d6417ce247c43262fb26eaeeb0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f5257c0b5624006e4db3d512fa485497.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f33be55bb09ec11a836b5a6024245294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_43018d47-f67c-580c-bdff-dc896cf4ced3/43018d47-f67c-580c-bdff-dc896cf4ced3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd9/89/d9897e1358d53578a591ad9d8d26f844/pa/SW25122_f7d736d1b002b64563da6ff19f162aee.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2009-06-24',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2009}
2026-04-27 07:56:24 [auto1.it] INFO: Saving data for SW25122: {'created_time': 1777276584.049829, 'last_price_update_time': 1777276584.049842, 'has_photos': True, 'auction_closing_time': 1777389259.0}
2026-04-27 07:56:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a649dd0a-fc9c-5db9-9b65-624bda30f0ec with identifier: XJ02099
2026-04-27 07:56:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a649dd0a-fc9c-5db9-9b65-624bda30f0ec with identifier: XJ02099
2026-04-27 07:56:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a649dd0a-fc9c-5db9-9b65-624bda30f0ec with identifier: XJ02099 to the API
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_ebc6fcc40e881d20d6942a9528178f04.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:32:26Z',
'fuel_type': 'diesel',
'id': 'a649dd0a-fc9c-5db9-9b65-624bda30f0ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ02099',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': 'Panda',
'odometer': 123758,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710923,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_ebc6fcc40e881d20d6942a9528178f04.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 710923,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_aed7212db3f095912a170802e75fc4be.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 726105,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_149c902b1a43cc7d5bdf6ed6d6f03a47.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 738923,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_7576f82a1da8f8f92f103e9544c9c61c.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 816524,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_807daa9abf11f321c3e84564ff6a6e60.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 824397,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_033130c9a9da09245f8db87ed1eb6507.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 762440,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e801e2a2439b25da1dd0778056892521.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159358,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_84b38f7bed9e83cfa871c2b340d3062c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1261123,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_4e75c6522f15e84adb0a4061a4ff62f9.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a649dd0a-fc9c-5db9-9b65-624bda30f0ec/a649dd0a-fc9c-5db9-9b65-624bda30f0ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 1265272,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/img57/89/5789eb3cfc50dee19bdda49a9251feba/pa/XJ02099_e4eb9ca7d365c6993c67a1d903d089b7.jpg',
'Width': 1499}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2006-05-23',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.3 JTD Cross 4x4',
'transmission': 'manual',
'trim': 'Cross 4x4',
'year': 2006}
2026-04-27 07:56:24 [auto1.it] INFO: Saving data for XJ02099: {'created_time': 1777276584.475283, 'last_price_update_time': 1777276584.475294, 'has_photos': True, 'auction_closing_time': 1777390346.0}
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_74f4cdd7c4011ca19e71941a22295972.jpg not downloaded yet
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cc950>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_7df2b39a40a416a9e59657ded017b8a1.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ec910>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6fefa8268c26c4499c9bf22fdda269e9.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c4e10>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_eb73b79843afb2f06b88c3a55cc5b00a.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5455310>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_71ba40c74750984d15a3a837336574cf.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6397c90>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_ebb46ca6122e21f8e94752de3d0ec37d.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af750>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_1114b615fd253be59c646b968a500a01.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8398bd0>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cc4c52ded9c105eefa7c829bab529bf5.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566c950>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_595969b6f47f84143c968cfe47dd9618.jpg saved to cache
2026-04-27 07:56:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_de7651de6c350bf1d1da538ecc2bd7e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_5f2401bf4965d8a3d9a3e1398b8f83c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_b1496b95d9af2ef77d960ec94e954da9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_4b57e94f14e9368f35b9b8cd169d94d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_35c0adaf4024f845c7c5dcce704fce60.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_b37b4746f0e7da58b6138fe2132bd26f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_c5a819bd392cd6496e3215db1db12b3a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_bddf7aa0656027428f8abe42e16c500a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_2c09c5e1e7f537d929047b6f57911c09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6c5148fe05d8f208f5da37162067bea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dcd10>
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_de7651de6c350bf1d1da538ecc2bd7e6.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_74f4cdd7c4011ca19e71941a22295972.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5843590>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_5f2401bf4965d8a3d9a3e1398b8f83c4.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549a410>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_b1496b95d9af2ef77d960ec94e954da9.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead543db90>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_4b57e94f14e9368f35b9b8cd169d94d8.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead543c610>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_35c0adaf4024f845c7c5dcce704fce60.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc
2026-04-27 07:56:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc, skipping ID generation
2026-04-27 07:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with scrape type 1
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc sending to next pipeline
2026-04-27 07:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc, identifier: FM45145
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581e050>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_b37b4746f0e7da58b6138fe2132bd26f.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5499990>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_c5a819bd392cd6496e3215db1db12b3a.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6411710>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_bddf7aa0656027428f8abe42e16c500a.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bcf90>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_2c09c5e1e7f537d929047b6f57911c09.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5081e183-2f81-5c56-9884-f268bdcbf64c
2026-04-27 07:56:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5081e183-2f81-5c56-9884-f268bdcbf64c, skipping ID generation
2026-04-27 07:56:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5081e183-2f81-5c56-9884-f268bdcbf64c with scrape type 1
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5081e183-2f81-5c56-9884-f268bdcbf64c sending to next pipeline
2026-04-27 07:56:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5081e183-2f81-5c56-9884-f268bdcbf64c, identifier: PN94026
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533bd10>
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6c5148fe05d8f208f5da37162067bea3.jpg saved to cache
2026-04-27 07:56:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with identifier: FM45145
2026-04-27 07:56:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with identifier: FM45145
2026-04-27 07:56:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc with identifier: FM45145 to the API
2026-04-27 07:56:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_35c0adaf4024f845c7c5dcce704fce60.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Roma',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:21:39Z',
'fuel_type': 'diesel',
'id': '8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FM45145',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Mazda',
'model': 'CX-3',
'odometer': 137000,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_5f2401bf4965d8a3d9a3e1398b8f83c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_35c0adaf4024f845c7c5dcce704fce60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_595969b6f47f84143c968cfe47dd9618.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_eb73b79843afb2f06b88c3a55cc5b00a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78191,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_3633f48df1db35914d51177a42526e65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_14b1629e7c579ec1aeaa62dad8de021a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_1e73e12704e65af326a7e5455e84dd9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_2c2ced6e8a6c7856dc093368ff3c34d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_f64dda58fe25fe915941dedfcad7f440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc/8a2ac497-6bbe-5e0e-8062-c1253ce3a7bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/9f/a79f7581226bf1f45e65af3295243250/pa/FM45145_372a62c6bc2a99ffb6ba40b25ddd9bd1.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2018-01-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-3 1.5 Diesel Exceed',
'transmission': 'manual',
'trim': 'Exceed',
'year': 2018}
2026-04-27 07:56:26 [auto1.it] INFO: Saving data for FM45145: {'created_time': 1777276586.193052, 'last_price_update_time': 1777276586.193064, 'has_photos': True, 'auction_closing_time': 1777389699.0}
2026-04-27 07:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5081e183-2f81-5c56-9884-f268bdcbf64c with identifier: PN94026
2026-04-27 07:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5081e183-2f81-5c56-9884-f268bdcbf64c with identifier: PN94026
2026-04-27 07:56:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5081e183-2f81-5c56-9884-f268bdcbf64c with identifier: PN94026 to the API
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_2c09c5e1e7f537d929047b6f57911c09.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:39:45Z',
'fuel_type': 'diesel',
'id': '5081e183-2f81-5c56-9884-f268bdcbf64c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PN94026',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Volvo',
'model': 'V60',
'odometer': 130579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_2c09c5e1e7f537d929047b6f57911c09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_bddf7aa0656027428f8abe42e16c500a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_b37b4746f0e7da58b6138fe2132bd26f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_ebb46ca6122e21f8e94752de3d0ec37d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_71ba40c74750984d15a3a837336574cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cc4c52ded9c105eefa7c829bab529bf5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d61832f890d82ba2b1bd3a57343168b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_cfec8c75a36966df8e7a26a20eb10429.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_4302ba054dd44b8cef8cded6f8feea98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5081e183-2f81-5c56-9884-f268bdcbf64c/5081e183-2f81-5c56-9884-f268bdcbf64c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/58/4058b965d5e2c3df33fac30689fc8a79/pa/PN94026_d97d99726c532a39b07c40829d09fd6f.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2019-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V60 2.0 D3 Momentum',
'transmission': 'automatic',
'trim': 'Momentum',
'year': 2019}
2026-04-27 07:56:26 [auto1.it] INFO: Saving data for PN94026: {'created_time': 1777276586.550334, 'last_price_update_time': 1777276586.550345, 'has_photos': True, 'auction_closing_time': 1777390785.0}
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SA42409> (referer: https://www.auto1.com/v1/car-details-view/SA42409/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NT74531> (referer: https://www.auto1.com/v1/car-details-view/NT74531/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EW44732/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD90856> (referer: https://www.auto1.com/v1/car-details-view/HD90856/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AY32045/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LZ09270> (referer: https://www.auto1.com/v1/car-details-view/LZ09270/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6357750>
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_74f4cdd7c4011ca19e71941a22295972.jpg saved to cache
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b
2026-04-27 07:56:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee0f6db3-2704-55ad-95fe-b59d07aaa25b, skipping ID generation
2026-04-27 07:56:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b with scrape type 1
2026-04-27 07:56:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee0f6db3-2704-55ad-95fe-b59d07aaa25b sending to next pipeline
2026-04-27 07:56:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee0f6db3-2704-55ad-95fe-b59d07aaa25b, identifier: VP82069
2026-04-27 07:56:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee0f6db3-2704-55ad-95fe-b59d07aaa25b with identifier: VP82069
2026-04-27 07:56:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee0f6db3-2704-55ad-95fe-b59d07aaa25b with identifier: VP82069
2026-04-27 07:56:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee0f6db3-2704-55ad-95fe-b59d07aaa25b with identifier: VP82069 to the API
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_74f4cdd7c4011ca19e71941a22295972.jpg>
{'auction_title': '',
'c_o_2_emission_value': 87,
'category': None,
'city': 'Roma',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 5',
'engine': '0.8L',
'engine_horse_power': 55,
'expiration_date': '2026-04-28T15:57:32Z',
'fuel_type': 'diesel',
'id': 'ee0f6db3-2704-55ad-95fe-b59d07aaa25b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VP82069',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Smart',
'model': 'fortwo',
'odometer': 116503,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_f8fd7f087000ebdbf6ae027dbd8843cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_7df2b39a40a416a9e59657ded017b8a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_1114b615fd253be59c646b968a500a01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6fefa8268c26c4499c9bf22fdda269e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_b1496b95d9af2ef77d960ec94e954da9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_4b57e94f14e9368f35b9b8cd169d94d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_de7651de6c350bf1d1da538ecc2bd7e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_c5a819bd392cd6496e3215db1db12b3a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_6c5148fe05d8f208f5da37162067bea3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0f6db3-2704-55ad-95fe-b59d07aaa25b/ee0f6db3-2704-55ad-95fe-b59d07aaa25b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/78/e27897872b6f606d8ad0b0b6122812ef/pa/VP82069_74f4cdd7c4011ca19e71941a22295972.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2013-09-12',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 0.8 CDI Pulse',
'transmission': 'automatic',
'trim': 'Pulse',
'year': 2013}
2026-04-27 07:56:27 [auto1.it] INFO: Saving data for VP82069: {'created_time': 1777276587.105394, 'last_price_update_time': 1777276587.105405, 'has_photos': True, 'auction_closing_time': 1777391852.0}
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with identifier: SA42409
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f2260174855e81c00593dfea5119eeaf.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with identifier: NT74531
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_14f4ddd04d3a7360abca3c3f169f5739.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70817c73-ad5f-513e-a543-21c17dd1ca6e with identifier: HD90856
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70817c73-ad5f-513e-a543-21c17dd1ca6e with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_2a1a8335d86459d6bfb97ed45db60fbc.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dd9a583-b2c9-5c02-b367-8953999758dc with identifier: LZ09270
2026-04-27 07:56:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd9a583-b2c9-5c02-b367-8953999758dc with scrape type 1
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_1b275cf60c867081303bf0981220a899.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_da46b1945fbb7450bd2c90f17a5fbd75.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_7e28eb0c1b23c01e4fb5e1d0a280d15d.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_21504dd2adbe6fe43a60526454357858.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_bd6bcaf39a7f14a95307c22d6a220a49.jpg not downloaded yet
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VK61820/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f7a0510b1759ade26728e385d82b6f37.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_cb6ce6e24cc5343cc3a1bcd75289f389.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_9dc909dc6480f355ab70004957a0bbb7.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_681213f8c109cbdf64719e2bf0d5c82e.jpg not downloaded yet
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_738815cdd0eea046b0aa08e4f621b6a7.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_467f4ea6a519ec70731cad5270b62ba4.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_be7e83a3f68da51b876aecf1e49cfaa3.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_43a60c37082f606296566448fc5572b8.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_cb433cef03bec587bfb99c9fb7269cd8.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_dc2f092f8f22c6f52c04f623fef979b2.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_3d264b6688bcc39366673db25acb246c.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_27a7a416abd7094fa341ffbdca214ec8.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_a302ec55f63cc432d4ecee6461c9dacc.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_c79385ceccfa1cb98a587c8fe5beb8f6.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_f563a05c876a5fbca88b2f7969c5cfbb.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_75a3be19ef5cfe5a4258fd11ff095bee.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_63a72991318063d890ddc9cbecb30ab2.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_36b9454d9e04cccb0451c03d1cd6c8f2.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_c3b0ee0c22cebd084ca7a5e6b182c050.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_00cd6147c18aa6da1acdc794daf3fbee.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_03360838fc07ad15ce30318a23565881.jpg not downloaded yet
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_bd6bcaf39a7f14a95307c22d6a220a49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_5dd69425d792fa213ce7116c38f3686e.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_99a671efc06312e0be7f97793519cc6d.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3de2c0063ce355d9da153ae66750eee8.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_8517a997db6953cf6f6e19fa45d94217.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_f9134100fba6ac2bc825804d8ab7fd2e.jpg not downloaded yet
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3c4eaa31b984127d55709e0b473cc30b.jpg not downloaded yet
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5332810>
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_bd6bcaf39a7f14a95307c22d6a220a49.jpg saved to cache
2026-04-27 07:56:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW74676/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TH50726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP94333/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC22557/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_f9134100fba6ac2bc825804d8ab7fd2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NM97698> (referer: https://www.auto1.com/v1/car-details-view/NM97698/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_03360838fc07ad15ce30318a23565881.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3de2c0063ce355d9da153ae66750eee8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3c4eaa31b984127d55709e0b473cc30b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GF55084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557eb90>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_f9134100fba6ac2bc825804d8ab7fd2e.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_8517a997db6953cf6f6e19fa45d94217.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_99a671efc06312e0be7f97793519cc6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-04-27 07:56:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4605b25-e638-54bf-a330-9b58b87e8043 with scrape type 1
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg not downloaded yet
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg not downloaded yet
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5836090>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_03360838fc07ad15ce30318a23565881.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_5dd69425d792fa213ce7116c38f3686e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg not downloaded yet
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD15526/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg not downloaded yet
2026-04-27 07:56:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bbb50>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3de2c0063ce355d9da153ae66750eee8.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a46d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3c4eaa31b984127d55709e0b473cc30b.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5596f90>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_8517a997db6953cf6f6e19fa45d94217.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg not downloaded yet
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_c3b0ee0c22cebd084ca7a5e6b182c050.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_00cd6147c18aa6da1acdc794daf3fbee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg not downloaded yet
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b15d0>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_99a671efc06312e0be7f97793519cc6d.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560f990>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_5dd69425d792fa213ce7116c38f3686e.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg not downloaded yet
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5594b50>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_c3b0ee0c22cebd084ca7a5e6b182c050.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64bb150>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6362b50>
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_00cd6147c18aa6da1acdc794daf3fbee.jpg saved to cache
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg not downloaded yet
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV61948/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM85940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA12696/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RU88902/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY79694/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA26135/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg not downloaded yet
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6363890>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_63a72991318063d890ddc9cbecb30ab2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5333950>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5882e50>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AT32399> (referer: https://www.auto1.com/v1/car-details-view/AT32399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_75a3be19ef5cfe5a4258fd11ff095bee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5678190>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_63a72991318063d890ddc9cbecb30ab2.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a94f50>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_36b9454d9e04cccb0451c03d1cd6c8f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d5510>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead543d310>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5584d50>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ac6fe8-c55e-547b-a55a-d66de9c3773d with identifier: AT32399
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_1dd45a8c0cb3b5eaed691da617c742b5.jpg not downloaded yet
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a610>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_75a3be19ef5cfe5a4258fd11ff095bee.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_c79385ceccfa1cb98a587c8fe5beb8f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f979063e0808d205898dfcf6d962df52.jpg not downloaded yet
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_f563a05c876a5fbca88b2f7969c5cfbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SV09218/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_9db3b975608d64aa247850d07b053438.jpg not downloaded yet
2026-04-27 07:56:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bf150>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_36b9454d9e04cccb0451c03d1cd6c8f2.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c0f10>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a14d0>
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg saved to cache
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4605b25-e638-54bf-a330-9b58b87e8043
2026-04-27 07:56:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4605b25-e638-54bf-a330-9b58b87e8043, skipping ID generation
2026-04-27 07:56:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4605b25-e638-54bf-a330-9b58b87e8043 with scrape type 1
2026-04-27 07:56:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4605b25-e638-54bf-a330-9b58b87e8043 sending to next pipeline
2026-04-27 07:56:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4605b25-e638-54bf-a330-9b58b87e8043, identifier: NM97698
2026-04-27 07:56:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-04-27 07:56:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698
2026-04-27 07:56:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4605b25-e638-54bf-a330-9b58b87e8043 with identifier: NM97698 to the API
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:57:47Z',
'fuel_type': 'diesel',
'id': 'e4605b25-e638-54bf-a330-9b58b87e8043',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NM97698',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'BMW',
'model': 'X4',
'odometer': 146738,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_42e67f04d371aa3fa19f3b4074470a94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_fabc223bf3b124cd1638c59f26e7decc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_642f79d4b7695015bf246a7aa633687f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_65f47137ca75504bd2066bf619ae49f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_b3c46b64c91361b4bbe9b0af68ed8027.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_1446c9e5d41b0568e3a16e6461ef10e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_ab29241e680187f4482948bbd4bfb285.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_a4e4401eaac2f9055fd6233768aedfc2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_0b941b1d7e9203d47a158436325d2cbd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4605b25-e638-54bf-a330-9b58b87e8043/e4605b25-e638-54bf-a330-9b58b87e8043_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4f/90/4f90f8a680177703ef33c40eabad594d/pa/NM97698_198f29a302746d35d5353bb1558b2d15.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2021-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X4 xDrive 20d Mild-Hybrid M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-04-27 07:56:30 [auto1.it] INFO: Saving data for NM97698: {'created_time': 1777276590.57055, 'last_price_update_time': 1777276590.570562, 'has_photos': True, 'auction_closing_time': 1777391867.0}
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_17017d459fbe5e6c95309e8915ac72a7.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_1dd45a8c0cb3b5eaed691da617c742b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VK61820> (referer: https://www.auto1.com/v1/car-details-view/VK61820/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC22557> (referer: https://www.auto1.com/v1/car-details-view/KC22557/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GF55084> (referer: https://www.auto1.com/v1/car-details-view/GF55084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD15526> (referer: https://www.auto1.com/v1/car-details-view/TD15526/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TH50726> (referer: https://www.auto1.com/v1/car-details-view/TH50726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW74676> (referer: https://www.auto1.com/v1/car-details-view/UW74676/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65afbd0>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_c79385ceccfa1cb98a587c8fe5beb8f6.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58724d0>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_f563a05c876a5fbca88b2f7969c5cfbb.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_a302ec55f63cc432d4ecee6461c9dacc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f1265c619acd332047be48f6a0d62c7c.jpg not downloaded yet
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f979063e0808d205898dfcf6d962df52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_b00aebc8ffe59db70e4ce76786bd08e9.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_90e6cb39a3774dbb72fffa151892275f.jpg not downloaded yet
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5645390>
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_1dd45a8c0cb3b5eaed691da617c742b5.jpg saved to cache
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7854b163-674a-5394-8c96-a46f13fbdef1 with identifier: VK61820
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854b163-674a-5394-8c96-a46f13fbdef1 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_6e3ff514fbdc424cadcf2b2f161ad66f.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1bff6203-ad4c-5cb1-a311-89c083b16a38 with identifier: KC22557
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bff6203-ad4c-5cb1-a311-89c083b16a38 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_23454dbefe9fd9d4c56aac979b2f8d65.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4f07698-d041-5127-8e18-563036465629 with identifier: GF55084
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4f07698-d041-5127-8e18-563036465629 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0febfa0db587058fb3ce61de24b97f11.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with identifier: TD15526
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_da6bb7b4beeb9f82b1041667285d6224.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3164992b-d609-515d-8cbd-60be2bda6e77 with identifier: TH50726
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3164992b-d609-515d-8cbd-60be2bda6e77 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_2ec2751aef5f601d95ffa009e0fd7fc3.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c974f66-d44d-5051-b9a8-b042763869b8 with identifier: UW74676
2026-04-27 07:56:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c974f66-d44d-5051-b9a8-b042763869b8 with scrape type 1
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_af7860405ad1508f1a1de3b46bdfe80e.jpg not downloaded yet
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_dc2f092f8f22c6f52c04f623fef979b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_17017d459fbe5e6c95309e8915ac72a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_be7e83a3f68da51b876aecf1e49cfaa3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_3d264b6688bcc39366673db25acb246c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_190c59453aec32be601817b89e3c48e6.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f6c0ed0e19d1ecc1c46a7cb83cf3abfc.jpg not downloaded yet
2026-04-27 07:56:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_0a643c9a925474f4b95eaa97b0d92b8b.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_37156ffc870100d888cb773439a7899a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_15836306f75927c91882cce546494c7d.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0792046fa70b505909ee00d0a6b4c5ee.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_6a4e1c494f6995c9084391fc7b0cb7da.jpg not downloaded yet
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_9db3b975608d64aa247850d07b053438.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_43a60c37082f606296566448fc5572b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_27a7a416abd7094fa341ffbdca214ec8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_cb433cef03bec587bfb99c9fb7269cd8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_bdfd86abebea728e7cc7734f659072fa.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_440af1bd2cbdbfd5d076fcfc2064cd48.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_4cff64b288c3910732eb1d0846bdb1e0.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_daede09d8d8c5ccaaea0467284f4f155.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_614db62e44c50af69627d56e1986e6ed.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_499af3a06a0affc8b08e6fcd2da7ca2a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_bb3ca8d7db05b8998bfd6b381d95319f.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5821590>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_a302ec55f63cc432d4ecee6461c9dacc.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5485890>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f979063e0808d205898dfcf6d962df52.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_da6bb7b4beeb9f82b1041667285d6224.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_022b9414fd7feff38b56a774445bccc1.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_fd35ec30a038e22301dd06a994ccaa6f.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c9e065bdccdd7426c19c0fbdc0c32274.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0fddce3f632a6d564bffc7b17a093efa.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_49f59ab4cd7a3ea27c30d303a7f59ecb.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_37792c9b0b9012a71f9783d9f5d4417b.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_c441c00bd7211a57794b724ceda4fd73.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571e810>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_dc2f092f8f22c6f52c04f623fef979b2.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f8790>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_17017d459fbe5e6c95309e8915ac72a7.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf2785e90>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_be7e83a3f68da51b876aecf1e49cfaa3.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596b090>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_3d264b6688bcc39366673db25acb246c.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_2ec2751aef5f601d95ffa009e0fd7fc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_af7860405ad1508f1a1de3b46bdfe80e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0febfa0db587058fb3ce61de24b97f11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f1265c619acd332047be48f6a0d62c7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_90e6cb39a3774dbb72fffa151892275f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_3a69d268bd1dcf9d0d45bca28c4fb1fd.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c0fb631f3d764de0b85e011c74c6bb35.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_309b251f978d548c25122a6241660e99.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_c5b35f168a969ec45c0d694938df24f6.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_d90cfa5d5cd9344354d228e91db06e1a.jpg not downloaded yet
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_8a991d977ba24afc8d181dd417669173.jpg not downloaded yet
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3e750>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_9db3b975608d64aa247850d07b053438.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63a0e50>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_43a60c37082f606296566448fc5572b8.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593d310>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_27a7a416abd7094fa341ffbdca214ec8.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bd310>
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_cb433cef03bec587bfb99c9fb7269cd8.jpg saved to cache
2026-04-27 07:56:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_23454dbefe9fd9d4c56aac979b2f8d65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_6e3ff514fbdc424cadcf2b2f161ad66f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ffa50>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_da6bb7b4beeb9f82b1041667285d6224.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_499af3a06a0affc8b08e6fcd2da7ca2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_614db62e44c50af69627d56e1986e6ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_bb3ca8d7db05b8998bfd6b381d95319f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f07e441fa0fb666f4729f27a6de57494.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_024247b01673fb8f7ebf8563643ca46d.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_880ed91a524c5f54907070b1f922c1fd.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_17848373109699aaca90ee67f04f23e0.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0bedcebe3adff2d18d764ba5d8389a18.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9cbee28ab8b6edd87cf835e1e87ea55a.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_daede09d8d8c5ccaaea0467284f4f155.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_4cff64b288c3910732eb1d0846bdb1e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_b00aebc8ffe59db70e4ce76786bd08e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64897d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_2ec2751aef5f601d95ffa009e0fd7fc3.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5842890>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_af7860405ad1508f1a1de3b46bdfe80e.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead634bcd0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0febfa0db587058fb3ce61de24b97f11.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0b10>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f1265c619acd332047be48f6a0d62c7c.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943e90>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_90e6cb39a3774dbb72fffa151892275f.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_c441c00bd7211a57794b724ceda4fd73.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_10b6496d1de2426eb843b916c29fe6c3.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_403dd5cef145ad82de61f7ea4ce133f6.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_8dad89fc4e91307790fe8d4a96b49738.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_6113dd34f4dc1a7e121799393d5fceac.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_079ca73ee82b75a28fcf0e334fec41ba.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_a1a7ded3ca19044e1b06dbdb8d319726.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA12696> (referer: https://www.auto1.com/v1/car-details-view/XA12696/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf27869d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_23454dbefe9fd9d4c56aac979b2f8d65.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d750>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_6e3ff514fbdc424cadcf2b2f161ad66f.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_49f59ab4cd7a3ea27c30d303a7f59ecb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_37792c9b0b9012a71f9783d9f5d4417b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP94333> (referer: https://www.auto1.com/v1/car-details-view/PP94333/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_8a991d977ba24afc8d181dd417669173.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_c5b35f168a969ec45c0d694938df24f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_2d0c9675b9b3fb55fabd93a4e54c48a4.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_9d09ddce4e118416f99fd9b3ae9eb2af.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_545bc602c245ea4a055d27f98632ec50.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_d2773b094387ee6793b823b67acc3a18.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_db14be5ec3715e54fe66876ce74c5d55.jpg not downloaded yet
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_de0aaa63c877cd19afc041ac2e989ac6.jpg not downloaded yet
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA26135> (referer: https://www.auto1.com/v1/car-details-view/XA26135/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY79694> (referer: https://www.auto1.com/v1/car-details-view/CY79694/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RU88902> (referer: https://www.auto1.com/v1/car-details-view/RU88902/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV61948> (referer: https://www.auto1.com/v1/car-details-view/XV61948/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57522d0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_499af3a06a0affc8b08e6fcd2da7ca2a.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5627050>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_614db62e44c50af69627d56e1986e6ed.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64aff50>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_bb3ca8d7db05b8998bfd6b381d95319f.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6396ad0>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_daede09d8d8c5ccaaea0467284f4f155.jpg saved to cache
2026-04-27 07:56:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5624090>
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_4cff64b288c3910732eb1d0846bdb1e0.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5325b10>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_b00aebc8ffe59db70e4ce76786bd08e9.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_d90cfa5d5cd9344354d228e91db06e1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c0fb631f3d764de0b85e011c74c6bb35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_38c132548885391dfb6a857f24899208.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_d133ff0c765ec80a2f98c4385ab2f32b.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_74118885ead38faf5c51b1f9c9ec4b5b.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_0ba9b244c37e63650d76d5866de96857.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_f1be01ec592b56bfa68a9c987a597352.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_fc8e5b2fc393abc5b0a217e4b486ce51.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_3a69d268bd1dcf9d0d45bca28c4fb1fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_309b251f978d548c25122a6241660e99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM85940> (referer: https://www.auto1.com/v1/car-details-view/PM85940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5327350>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_c441c00bd7211a57794b724ceda4fd73.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae986554-b72d-5eed-ba3b-79a480fc0029 with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg not downloaded yet
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589f990>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_49f59ab4cd7a3ea27c30d303a7f59ecb.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c3e90>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_37792c9b0b9012a71f9783d9f5d4417b.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ba81c176-6240-54b8-bba7-a1edd579bee7 with identifier: PP94333
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba81c176-6240-54b8-bba7-a1edd579bee7 with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_df7fea0e8d5f21b9b68d74fcc508c57d.jpg not downloaded yet
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548aa90>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_8a991d977ba24afc8d181dd417669173.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659bed0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_c5b35f168a969ec45c0d694938df24f6.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51e11cc7-26d6-5872-9a47-effd14b3a262 with identifier: XA26135
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e11cc7-26d6-5872-9a47-effd14b3a262 with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_efe12700c7db5bd28a2bda78f1b9810b.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8961610f-f239-53f2-91bb-7354ef855f5c with identifier: CY79694
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8961610f-f239-53f2-91bb-7354ef855f5c with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_ec0ef1faf964c7ff3e9a056404fb46c7.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b688c634-48ca-519e-a67e-8aaa8e9965da with identifier: RU88902
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b688c634-48ca-519e-a67e-8aaa8e9965da with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_31988091074d7303ec4560f783514c52.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with identifier: XV61948
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_ba0b0a6754ff2898822a8ca032956ff7.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_a1a7ded3ca19044e1b06dbdb8d319726.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_6113dd34f4dc1a7e121799393d5fceac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_52d00dd180a8b2ac2d26ae139e71bc5c.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_e4dd7fece97f4b47fce0a98c5345a0bc.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_4526be66489b0981454b5f69262a31ac.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_5c61fc696bd9ee08229650a93afb888c.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_cd6d6a6aa5f628f813c19c5df6200d2a.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9eaebc844a0fd3915dda0c620aa599ab.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9cbee28ab8b6edd87cf835e1e87ea55a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_8dad89fc4e91307790fe8d4a96b49738.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_ea3a6ce0934244997c6ca59e6b24c5c0.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_39dd44434f6a5f71d3dbecc1a4ab16b0.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_32ac303f9fb4cb62865fb68769ff2aa3.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_9922e837ff2e1d966b969613671e8e64.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_cd0700be7f3322d4371ec4f45865d759.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_403dd5cef145ad82de61f7ea4ce133f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_079ca73ee82b75a28fcf0e334fec41ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f6d90>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_d90cfa5d5cd9344354d228e91db06e1a.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55109d0>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c0fb631f3d764de0b85e011c74c6bb35.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed890>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_3a69d268bd1dcf9d0d45bca28c4fb1fd.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513350>
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_309b251f978d548c25122a6241660e99.jpg saved to cache
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-04-27 07:56:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a570ab3-6667-528e-b703-805d6f07358d with scrape type 1
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_17848373109699aaca90ee67f04f23e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_54244e9a62f37c5c484f749ead31a702.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_3d4e50688b6e7326ff7a832187e1ba7b.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_22d335d39f72303ae0bbe94b19f0bf46.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_f8acc430b261a3c9a8ebe8420e63bd3f.jpg not downloaded yet
2026-04-27 07:56:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_a8508102c759f26630e5d64b38770e75.jpg not downloaded yet
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_10b6496d1de2426eb843b916c29fe6c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0bedcebe3adff2d18d764ba5d8389a18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg not downloaded yet
2026-04-27 07:56:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_880ed91a524c5f54907070b1f922c1fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c4d716463ca744eb7fdd016d207ecb53.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_33dffb5ee5ad3c5552f1316ca8d4aad4.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_bc032d5d1c1cac00e7ea5f0b6adde190.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_63fd54dd99b53656642539f62241d35e.jpg not downloaded yet
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_93b9934350357bcce53d76b6ffcd22e9.jpg not downloaded yet
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4e08ed0>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_a1a7ded3ca19044e1b06dbdb8d319726.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582090>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_6113dd34f4dc1a7e121799393d5fceac.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659ef90>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9cbee28ab8b6edd87cf835e1e87ea55a.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c8c50>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_8dad89fc4e91307790fe8d4a96b49738.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54a2c90>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_403dd5cef145ad82de61f7ea4ce133f6.jpg saved to cache
2026-04-27 07:56:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ef890>
2026-04-27 07:56:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_079ca73ee82b75a28fcf0e334fec41ba.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_db14be5ec3715e54fe66876ce74c5d55.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_de0aaa63c877cd19afc041ac2e989ac6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c398520fadab28092c29743227d898eb.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a4c163b70e40cf7813a71ef5e0573f5.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_6a365c2a12d34f6d8ebb99fcd63b0b67.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_eb9c64894c74634eed2dc171715c5193.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_fa12d7961b8e57a4b1d5d2cc00446d9e.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5376e10>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_17848373109699aaca90ee67f04f23e0.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_d2773b094387ee6793b823b67acc3a18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_024247b01673fb8f7ebf8563643ca46d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f07e441fa0fb666f4729f27a6de57494.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_fc8e5b2fc393abc5b0a217e4b486ce51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg not downloaded yet
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_0ba9b244c37e63650d76d5866de96857.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f446ac3865082c6470d96cb38cffd86e.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_64d79410e70d6378770d1406472d13b0.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_e4d19189ced0a318c43174f3e59f047e.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4c405c9d79507845c8a456773e2ea1.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b9f90>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_10b6496d1de2426eb843b916c29fe6c3.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f8a10>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0bedcebe3adff2d18d764ba5d8389a18.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5394850>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_880ed91a524c5f54907070b1f922c1fd.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_5c61fc696bd9ee08229650a93afb888c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_4526be66489b0981454b5f69262a31ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_f1be01ec592b56bfa68a9c987a597352.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9eaebc844a0fd3915dda0c620aa599ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54bbf90>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_db14be5ec3715e54fe66876ce74c5d55.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2b4d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_de0aaa63c877cd19afc041ac2e989ac6.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_cd0700be7f3322d4371ec4f45865d759.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_a8508102c759f26630e5d64b38770e75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_cd6d6a6aa5f628f813c19c5df6200d2a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f76472a2b74b52e7bdcbc8c8be1f22a6.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a930f934fe1dacdb4c12aa05f91bb0c.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a4241cb621c914d14889ec2ccd84e0c8.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_baa4efb042ea864db52b5ab3c85d19e7.jpg not downloaded yet
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg not downloaded yet
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fd490>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_d2773b094387ee6793b823b67acc3a18.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c8690>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_024247b01673fb8f7ebf8563643ca46d.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559c690>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f07e441fa0fb666f4729f27a6de57494.jpg saved to cache
2026-04-27 07:56:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ef4d0>
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_fc8e5b2fc393abc5b0a217e4b486ce51.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5590450>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_0ba9b244c37e63650d76d5866de96857.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_63fd54dd99b53656642539f62241d35e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_f8acc430b261a3c9a8ebe8420e63bd3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f226437fcded849e7ad677ba49b2d845.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_809300b74ec1c05ef617285455925171.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_74c675813f827b2a50df6b9a813398dc.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4415692cf01fd900d2a26a5678080e.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_93b9934350357bcce53d76b6ffcd22e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c4d716463ca744eb7fdd016d207ecb53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_22d335d39f72303ae0bbe94b19f0bf46.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_fe52a1ec5175ef3107a23e668e3b9793.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_58f4bd224734d2d159a2b3d2f1b5f99f.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_977e402ed18b194dd8728c3db1fdbeee.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_c403ee0c622142da26370249fc650a14.jpg not downloaded yet
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c7710>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_5c61fc696bd9ee08229650a93afb888c.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566a890>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_4526be66489b0981454b5f69262a31ac.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba990>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_f1be01ec592b56bfa68a9c987a597352.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a375d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9eaebc844a0fd3915dda0c620aa599ab.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5480cd0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_cd0700be7f3322d4371ec4f45865d759.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ec3d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_a8508102c759f26630e5d64b38770e75.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6458950>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_cd6d6a6aa5f628f813c19c5df6200d2a.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_bc032d5d1c1cac00e7ea5f0b6adde190.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_2153d8a407d6cc211ea6f056a9579df2.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_afc681359aaf8f7256e51b5d0f43bdad.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a5abc4dc31d7a3e749bc6ab46fbca4d8.jpg not downloaded yet
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9309fe25168bf7c3c6d9259f26bc0447.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_fa12d7961b8e57a4b1d5d2cc00446d9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg not downloaded yet
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557c8d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_63fd54dd99b53656642539f62241d35e.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581f090>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_f8acc430b261a3c9a8ebe8420e63bd3f.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57d79d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_93b9934350357bcce53d76b6ffcd22e9.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581f3d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c4d716463ca744eb7fdd016d207ecb53.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5484710>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ec90>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_22d335d39f72303ae0bbe94b19f0bf46.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_eb9c64894c74634eed2dc171715c5193.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_6a365c2a12d34f6d8ebb99fcd63b0b67.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg not downloaded yet
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4c405c9d79507845c8a456773e2ea1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486550>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_bc032d5d1c1cac00e7ea5f0b6adde190.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ba8d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg saved to cache
2026-04-27 07:56:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ba9d0>
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_fa12d7961b8e57a4b1d5d2cc00446d9e.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_e4d19189ced0a318c43174f3e59f047e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53ba4d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_eb9c64894c74634eed2dc171715c5193.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead539b290>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_6a365c2a12d34f6d8ebb99fcd63b0b67.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54ac4d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ec90>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4c405c9d79507845c8a456773e2ea1.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_baa4efb042ea864db52b5ab3c85d19e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a4241cb621c914d14889ec2ccd84e0c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4415692cf01fd900d2a26a5678080e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551c790>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_e4d19189ced0a318c43174f3e59f047e.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_33dffb5ee5ad3c5552f1316ca8d4aad4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_809300b74ec1c05ef617285455925171.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_74c675813f827b2a50df6b9a813398dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a4c163b70e40cf7813a71ef5e0573f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f226437fcded849e7ad677ba49b2d845.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_c403ee0c622142da26370249fc650a14.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a5abc4dc31d7a3e749bc6ab46fbca4d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549c410>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_baa4efb042ea864db52b5ab3c85d19e7.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_2153d8a407d6cc211ea6f056a9579df2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9b290>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a4241cb621c914d14889ec2ccd84e0c8.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead569a150>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4415692cf01fd900d2a26a5678080e.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_977e402ed18b194dd8728c3db1fdbeee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9309fe25168bf7c3c6d9259f26bc0447.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_afc681359aaf8f7256e51b5d0f43bdad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5589290>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_33dffb5ee5ad3c5552f1316ca8d4aad4.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5abb4d0>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_809300b74ec1c05ef617285455925171.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63fbf90>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_74c675813f827b2a50df6b9a813398dc.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dcc50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a4c163b70e40cf7813a71ef5e0573f5.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5966e50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f226437fcded849e7ad677ba49b2d845.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5abad50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_c403ee0c622142da26370249fc650a14.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dec50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a5abc4dc31d7a3e749bc6ab46fbca4d8.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_fe52a1ec5175ef3107a23e668e3b9793.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580ee90>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_2153d8a407d6cc211ea6f056a9579df2.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59a5e50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dff50>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_977e402ed18b194dd8728c3db1fdbeee.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5872590>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9309fe25168bf7c3c6d9259f26bc0447.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54de350>
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_afc681359aaf8f7256e51b5d0f43bdad.jpg saved to cache
2026-04-27 07:56:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f446ac3865082c6470d96cb38cffd86e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f76472a2b74b52e7bdcbc8c8be1f22a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_64d79410e70d6378770d1406472d13b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead546d2d0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549ced0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53a1a50>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_fe52a1ec5175ef3107a23e668e3b9793.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551dc90>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551f7d0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f9390>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_58f4bd224734d2d159a2b3d2f1b5f99f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c398520fadab28092c29743227d898eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5870610>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64749d0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552e810>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f446ac3865082c6470d96cb38cffd86e.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dc410>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5668510>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f76472a2b74b52e7bdcbc8c8be1f22a6.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476950>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_64d79410e70d6378770d1406472d13b0.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a930f934fe1dacdb4c12aa05f91bb0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_3d4e50688b6e7326ff7a832187e1ba7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5837890>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0410>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_58f4bd224734d2d159a2b3d2f1b5f99f.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5481150>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c398520fadab28092c29743227d898eb.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65b9890>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead591bfd0>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c650>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a930f934fe1dacdb4c12aa05f91bb0c.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead591a710>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b8490>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_3d4e50688b6e7326ff7a832187e1ba7b.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_9922e837ff2e1d966b969613671e8e64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_e4dd7fece97f4b47fce0a98c5345a0bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_54244e9a62f37c5c484f749ead31a702.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_ea3a6ce0934244997c6ca59e6b24c5c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_32ac303f9fb4cb62865fb68769ff2aa3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae5913990>
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg saved to cache
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a570ab3-6667-528e-b703-805d6f07358d
2026-04-27 07:56:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a570ab3-6667-528e-b703-805d6f07358d, skipping ID generation
2026-04-27 07:56:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a570ab3-6667-528e-b703-805d6f07358d with scrape type 1
2026-04-27 07:56:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a570ab3-6667-528e-b703-805d6f07358d sending to next pipeline
2026-04-27 07:56:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a570ab3-6667-528e-b703-805d6f07358d, identifier: PM85940
2026-04-27 07:56:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-04-27 07:56:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940
2026-04-27 07:56:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a570ab3-6667-528e-b703-805d6f07358d with identifier: PM85940 to the API
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:48:46Z',
'fuel_type': 'diesel',
'id': '6a570ab3-6667-528e-b703-805d6f07358d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM85940',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Ford',
'model': 'Kuga',
'odometer': 113138,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_c4ebf98679e26862fd9a24c1fa27f840.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_e7a6f9f128f5b49c49685ed78183ee19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_443336954f139e0578927ed279f3c0be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_b681769933655521f831a7d3ed38355d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_90455a86c66b68bb7ecd6ff62181e680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_8da0cb82a5d4cd8ceb4fe51f5805a465.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_04c008f097bb13629fff03e6e4ddac8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79368,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_cc841ece8c9f03570bccd90e6546706a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_dba9118eccce288a0afe4def364d0bf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a570ab3-6667-528e-b703-805d6f07358d/6a570ab3-6667-528e-b703-805d6f07358d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68354,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgcd/17/cd17794c9adfdc253c02c0c63607992c/pa/PM85940_76e253e2607a7aa822052374cc245fe7.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2011-08-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'automatic',
'trim': 'Titanium',
'year': 2011}
2026-04-27 07:56:40 [auto1.it] INFO: Saving data for PM85940: {'created_time': 1777276600.57466, 'last_price_update_time': 1777276600.574671, 'has_photos': True, 'auction_closing_time': 1777391326.0}
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_31988091074d7303ec4560f783514c52.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_ba0b0a6754ff2898822a8ca032956ff7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_ec0ef1faf964c7ff3e9a056404fb46c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_52d00dd180a8b2ac2d26ae139e71bc5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_df7fea0e8d5f21b9b68d74fcc508c57d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568d8d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5337a50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c7d50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_9922e837ff2e1d966b969613671e8e64.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a9e90>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_e4dd7fece97f4b47fce0a98c5345a0bc.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c7950>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_54244e9a62f37c5c484f749ead31a702.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c48d0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_ea3a6ce0934244997c6ca59e6b24c5c0.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c1ed0>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_32ac303f9fb4cb62865fb68769ff2aa3.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_74118885ead38faf5c51b1f9c9ec4b5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dfa50>
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_31988091074d7303ec4560f783514c52.jpg saved to cache
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b688c634-48ca-519e-a67e-8aaa8e9965da
2026-04-27 07:56:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b688c634-48ca-519e-a67e-8aaa8e9965da, skipping ID generation
2026-04-27 07:56:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b688c634-48ca-519e-a67e-8aaa8e9965da with scrape type 1
2026-04-27 07:56:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b688c634-48ca-519e-a67e-8aaa8e9965da sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b688c634-48ca-519e-a67e-8aaa8e9965da, identifier: RU88902
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2e310>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae986554-b72d-5eed-ba3b-79a480fc0029
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae986554-b72d-5eed-ba3b-79a480fc0029, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae986554-b72d-5eed-ba3b-79a480fc0029 with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae986554-b72d-5eed-ba3b-79a480fc0029 sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae986554-b72d-5eed-ba3b-79a480fc0029, identifier: XA12696
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59670d0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_ba0b0a6754ff2898822a8ca032956ff7.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 296a08b1-bba0-5cb6-91aa-8e8d7da69001, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 296a08b1-bba0-5cb6-91aa-8e8d7da69001 sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 296a08b1-bba0-5cb6-91aa-8e8d7da69001, identifier: XV61948
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead640a050>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_ec0ef1faf964c7ff3e9a056404fb46c7.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8961610f-f239-53f2-91bb-7354ef855f5c
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8961610f-f239-53f2-91bb-7354ef855f5c, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8961610f-f239-53f2-91bb-7354ef855f5c with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8961610f-f239-53f2-91bb-7354ef855f5c sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8961610f-f239-53f2-91bb-7354ef855f5c, identifier: CY79694
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5964b90>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_52d00dd180a8b2ac2d26ae139e71bc5c.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551fbd0>
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_df7fea0e8d5f21b9b68d74fcc508c57d.jpg saved to cache
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ba81c176-6240-54b8-bba7-a1edd579bee7
2026-04-27 07:56:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ba81c176-6240-54b8-bba7-a1edd579bee7, skipping ID generation
2026-04-27 07:56:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ba81c176-6240-54b8-bba7-a1edd579bee7 with scrape type 1
2026-04-27 07:56:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ba81c176-6240-54b8-bba7-a1edd579bee7 sending to next pipeline
2026-04-27 07:56:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ba81c176-6240-54b8-bba7-a1edd579bee7, identifier: PP94333
2026-04-27 07:56:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b688c634-48ca-519e-a67e-8aaa8e9965da with identifier: RU88902
2026-04-27 07:56:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b688c634-48ca-519e-a67e-8aaa8e9965da with identifier: RU88902
2026-04-27 07:56:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b688c634-48ca-519e-a67e-8aaa8e9965da with identifier: RU88902 to the API
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_31988091074d7303ec4560f783514c52.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'city': 'Reggio Emilia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:38:30Z',
'fuel_type': 'diesel',
'id': 'b688c634-48ca-519e-a67e-8aaa8e9965da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RU88902',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Audi',
'model': 'A4',
'odometer': 277186,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_31988091074d7303ec4560f783514c52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_9922e837ff2e1d966b969613671e8e64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_f8acc430b261a3c9a8ebe8420e63bd3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_63fd54dd99b53656642539f62241d35e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_eb9c64894c74634eed2dc171715c5193.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_e4d19189ced0a318c43174f3e59f047e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a4241cb621c914d14889ec2ccd84e0c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_74c675813f827b2a50df6b9a813398dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_977e402ed18b194dd8728c3db1fdbeee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b688c634-48ca-519e-a67e-8aaa8e9965da/b688c634-48ca-519e-a67e-8aaa8e9965da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55204,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc7/eb/c7eb93fe4bded33af35ab65d17cc3465/pa/RU88902_a5abc4dc31d7a3e749bc6ab46fbca4d8.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2013-12-19',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI quattro Advanced',
'transmission': 'automatic',
'trim': 'quattro Advanced',
'year': 2013}
2026-04-27 07:56:42 [auto1.it] INFO: Saving data for RU88902: {'created_time': 1777276602.043873, 'last_price_update_time': 1777276602.043884, 'has_photos': True, 'auction_closing_time': 1777390710.0}
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae986554-b72d-5eed-ba3b-79a480fc0029 with identifier: XA12696 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Capannori',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:46:32Z',
'fuel_type': 'diesel',
'id': 'ae986554-b72d-5eed-ba3b-79a480fc0029',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA12696',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Nissan',
'model': 'Juke',
'odometer': 201013,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_324024bf6eb322637511555cbaf510d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_cf49110200c7315cbc2f33637313b4f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57301,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1bf3ffa6234e4439bc9fe64bdc6da395.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48442,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_82f2147f8284b591c0ddd8d2206ec9a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51098,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4759e3b2e79e65056dedf745000c4158.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_163c3bf6a6534b00541c8953d5e48cc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41532,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_4b4560a9a054e0c036a19f201eb29858.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_6bfb6b3770b2dc99372d0ec907626ac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57024,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_ab9a3d05f263fe97b27a8316658d1495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae986554-b72d-5eed-ba3b-79a480fc0029/ae986554-b72d-5eed-ba3b-79a480fc0029_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56421,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/8c/828c01f15df772c9d33eac4d979c5555/pa/XA12696_1951c6f63a66d9b8a2439d6547e57bbd.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Juke 1.5 Turbodiesel Visia',
'transmission': 'manual',
'trim': 'Visia',
'year': 2014}
2026-04-27 07:56:42 [auto1.it] INFO: Saving data for XA12696: {'created_time': 1777276602.451647, 'last_price_update_time': 1777276602.451657, 'has_photos': True, 'auction_closing_time': 1777391192.0}
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with identifier: XV61948
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with identifier: XV61948
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 296a08b1-bba0-5cb6-91aa-8e8d7da69001 with identifier: XV61948 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_ba0b0a6754ff2898822a8ca032956ff7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:21:32Z',
'fuel_type': 'diesel',
'id': '296a08b1-bba0-5cb6-91aa-8e8d7da69001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV61948',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Renault',
'model': 'Megane',
'odometer': 235791,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_ba0b0a6754ff2898822a8ca032956ff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_cd0700be7f3322d4371ec4f45865d759.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_a8508102c759f26630e5d64b38770e75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_93b9934350357bcce53d76b6ffcd22e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66165,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_fa12d7961b8e57a4b1d5d2cc00446d9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4c405c9d79507845c8a456773e2ea1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_baa4efb042ea864db52b5ab3c85d19e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9f4415692cf01fd900d2a26a5678080e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_c403ee0c622142da26370249fc650a14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_296a08b1-bba0-5cb6-91aa-8e8d7da69001/296a08b1-bba0-5cb6-91aa-8e8d7da69001_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img63/da/63daa9e473d089fe56d1b202651b8fb3/pa/XV61948_9309fe25168bf7c3c6d9259f26bc0447.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2017-06-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.5 dCi Energy Intens',
'transmission': 'automatic',
'trim': 'Intens',
'year': 2017}
2026-04-27 07:56:42 [auto1.it] INFO: Saving data for XV61948: {'created_time': 1777276602.833413, 'last_price_update_time': 1777276602.833425, 'has_photos': True, 'auction_closing_time': 1777389692.0}
2026-04-27 07:56:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8961610f-f239-53f2-91bb-7354ef855f5c with identifier: CY79694
2026-04-27 07:56:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8961610f-f239-53f2-91bb-7354ef855f5c with identifier: CY79694
2026-04-27 07:56:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8961610f-f239-53f2-91bb-7354ef855f5c with identifier: CY79694 to the API
2026-04-27 07:56:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_ec0ef1faf964c7ff3e9a056404fb46c7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.1L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:24:17Z',
'fuel_type': 'petrol',
'id': '8961610f-f239-53f2-91bb-7354ef855f5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY79694',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Mitsubishi',
'model': 'Colt',
'odometer': 112832,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_ec0ef1faf964c7ff3e9a056404fb46c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_32ac303f9fb4cb62865fb68769ff2aa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_22d335d39f72303ae0bbe94b19f0bf46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_bc032d5d1c1cac00e7ea5f0b6adde190.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8961610f-f239-53f2-91bb-7354ef855f5c/8961610f-f239-53f2-91bb-7354ef855f5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/a8/d3a8aa6c802ea282027789de8cedacde/pa/CY79694_6a365c2a12d34f6d8ebb99fcd63b0b67.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2009-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mitsubishi Colt 1.1 Basis',
'transmission': 'manual',
'trim': 'Basis',
'year': 2009}
2026-04-27 07:56:43 [auto1.it] INFO: Saving data for CY79694: {'created_time': 1777276603.265786, 'last_price_update_time': 1777276603.265799, 'has_photos': True, 'auction_closing_time': 1777389857.0}
2026-04-27 07:56:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ba81c176-6240-54b8-bba7-a1edd579bee7 with identifier: PP94333
2026-04-27 07:56:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ba81c176-6240-54b8-bba7-a1edd579bee7 with identifier: PP94333
2026-04-27 07:56:43 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ba81c176-6240-54b8-bba7-a1edd579bee7 with identifier: PP94333 to the API
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_df7fea0e8d5f21b9b68d74fcc508c57d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 233,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 3',
'engine': '2.7L',
'engine_horse_power': 228,
'expiration_date': '2026-04-28T15:33:27Z',
'fuel_type': 'petrol',
'id': 'ba81c176-6240-54b8-bba7-a1edd579bee7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP94333',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Porsche',
'model': 'Boxster',
'odometer': 136218,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_df7fea0e8d5f21b9b68d74fcc508c57d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_ea3a6ce0934244997c6ca59e6b24c5c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_54244e9a62f37c5c484f749ead31a702.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c4d716463ca744eb7fdd016d207ecb53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_c398520fadab28092c29743227d898eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f446ac3865082c6470d96cb38cffd86e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f76472a2b74b52e7bdcbc8c8be1f22a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_f226437fcded849e7ad677ba49b2d845.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_fe52a1ec5175ef3107a23e668e3b9793.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ba81c176-6240-54b8-bba7-a1edd579bee7/ba81c176-6240-54b8-bba7-a1edd579bee7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77842,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img16/d7/16d71020106860601f45075b9db91547/pa/PP94333_2153d8a407d6cc211ea6f056a9579df2.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2004-05-19',
'seats_number': 2,
'seller_name': None,
'title': 'Porsche Boxster 2.7',
'transmission': 'manual',
'trim': '',
'year': 2004}
2026-04-27 07:56:43 [auto1.it] INFO: Saving data for PP94333: {'created_time': 1777276603.672025, 'last_price_update_time': 1777276603.672038, 'has_photos': True, 'auction_closing_time': 1777390407.0}
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_d133ff0c765ec80a2f98c4385ab2f32b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_9d09ddce4e118416f99fd9b3ae9eb2af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_2d0c9675b9b3fb55fabd93a4e54c48a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_38c132548885391dfb6a857f24899208.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_545bc602c245ea4a055d27f98632ec50.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_39dd44434f6a5f71d3dbecc1a4ab16b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0fddce3f632a6d564bffc7b17a093efa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed650>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_74118885ead38faf5c51b1f9c9ec4b5b.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_efe12700c7db5bd28a2bda78f1b9810b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c9e065bdccdd7426c19c0fbdc0c32274.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547dd90>
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:43 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_d133ff0c765ec80a2f98c4385ab2f32b.jpg saved to cache
2026-04-27 07:56:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_022b9414fd7feff38b56a774445bccc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_bdfd86abebea728e7cc7734f659072fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0792046fa70b505909ee00d0a6b4c5ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_6a4e1c494f6995c9084391fc7b0cb7da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_15836306f75927c91882cce546494c7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_fd35ec30a038e22301dd06a994ccaa6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5818050>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_9d09ddce4e118416f99fd9b3ae9eb2af.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63ab610>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_2d0c9675b9b3fb55fabd93a4e54c48a4.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55cbb50>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_38c132548885391dfb6a857f24899208.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65abc50>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_545bc602c245ea4a055d27f98632ec50.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6581e90>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_39dd44434f6a5f71d3dbecc1a4ab16b0.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f5f10>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0fddce3f632a6d564bffc7b17a093efa.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582e90>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_efe12700c7db5bd28a2bda78f1b9810b.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51e11cc7-26d6-5872-9a47-effd14b3a262
2026-04-27 07:56:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51e11cc7-26d6-5872-9a47-effd14b3a262, skipping ID generation
2026-04-27 07:56:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51e11cc7-26d6-5872-9a47-effd14b3a262 with scrape type 1
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51e11cc7-26d6-5872-9a47-effd14b3a262 sending to next pipeline
2026-04-27 07:56:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 51e11cc7-26d6-5872-9a47-effd14b3a262, identifier: XA26135
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566d3d0>
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c9e065bdccdd7426c19c0fbdc0c32274.jpg saved to cache
2026-04-27 07:56:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f6c0ed0e19d1ecc1c46a7cb83cf3abfc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_738815cdd0eea046b0aa08e4f621b6a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 51e11cc7-26d6-5872-9a47-effd14b3a262 with identifier: XA26135
2026-04-27 07:56:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 51e11cc7-26d6-5872-9a47-effd14b3a262 with identifier: XA26135
2026-04-27 07:56:44 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 51e11cc7-26d6-5872-9a47-effd14b3a262 with identifier: XA26135 to the API
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:44 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_efe12700c7db5bd28a2bda78f1b9810b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:28:54Z',
'fuel_type': 'diesel',
'id': '51e11cc7-26d6-5872-9a47-effd14b3a262',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA26135',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Fiat',
'model': '500L',
'odometer': 216142,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885400,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_efe12700c7db5bd28a2bda78f1b9810b.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 885400,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_39dd44434f6a5f71d3dbecc1a4ab16b0.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125622,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_3d4e50688b6e7326ff7a832187e1ba7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 891671,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_33dffb5ee5ad3c5552f1316ca8d4aad4.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 953633,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a4c163b70e40cf7813a71ef5e0573f5.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 120308,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_64d79410e70d6378770d1406472d13b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485040,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_7a930f934fe1dacdb4c12aa05f91bb0c.jpg',
'Width': 937},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105044,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_809300b74ec1c05ef617285455925171.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 641089,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_58f4bd224734d2d159a2b3d2f1b5f99f.jpg',
'Width': 1499},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_51e11cc7-26d6-5872-9a47-effd14b3a262/51e11cc7-26d6-5872-9a47-effd14b3a262_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583149,
'Height': 1000,
'OriginUrl': 'https://img-pa.auto1.com/imga8/9e/a89ece6b9bc69763074169683021ea28/pa/XA26135_afc681359aaf8f7256e51b5d0f43bdad.jpg',
'Width': 1499}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2014-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.6 JTDM Beats Edition',
'transmission': 'manual',
'trim': 'Beats Edition',
'year': 2014}
2026-04-27 07:56:45 [auto1.it] INFO: Saving data for XA26135: {'created_time': 1777276605.092973, 'last_price_update_time': 1777276605.092986, 'has_photos': True, 'auction_closing_time': 1777390134.0}
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_37156ffc870100d888cb773439a7899a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_440af1bd2cbdbfd5d076fcfc2064cd48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_0a643c9a925474f4b95eaa97b0d92b8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_190c59453aec32be601817b89e3c48e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_681213f8c109cbdf64719e2bf0d5c82e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_467f4ea6a519ec70731cad5270b62ba4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f8350>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_022b9414fd7feff38b56a774445bccc1.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c1790>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_bdfd86abebea728e7cc7734f659072fa.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549ce10>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0792046fa70b505909ee00d0a6b4c5ee.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3164992b-d609-515d-8cbd-60be2bda6e77
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3164992b-d609-515d-8cbd-60be2bda6e77, skipping ID generation
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3164992b-d609-515d-8cbd-60be2bda6e77 with scrape type 1
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3164992b-d609-515d-8cbd-60be2bda6e77 sending to next pipeline
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3164992b-d609-515d-8cbd-60be2bda6e77, identifier: TH50726
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5870e50>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_6a4e1c494f6995c9084391fc7b0cb7da.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5c974f66-d44d-5051-b9a8-b042763869b8
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5c974f66-d44d-5051-b9a8-b042763869b8, skipping ID generation
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c974f66-d44d-5051-b9a8-b042763869b8 with scrape type 1
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5c974f66-d44d-5051-b9a8-b042763869b8 sending to next pipeline
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5c974f66-d44d-5051-b9a8-b042763869b8, identifier: UW74676
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53423d0>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_15836306f75927c91882cce546494c7d.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba
2026-04-27 07:56:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba, skipping ID generation
2026-04-27 07:56:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with scrape type 1
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ea856d6-1f16-5c8e-8988-33d7e449c2ba sending to next pipeline
2026-04-27 07:56:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba, identifier: TD15526
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57a8c10>
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_fd35ec30a038e22301dd06a994ccaa6f.jpg saved to cache
2026-04-27 07:56:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3164992b-d609-515d-8cbd-60be2bda6e77 with identifier: TH50726
2026-04-27 07:56:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3164992b-d609-515d-8cbd-60be2bda6e77 with identifier: TH50726
2026-04-27 07:56:45 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3164992b-d609-515d-8cbd-60be2bda6e77 with identifier: TH50726 to the API
2026-04-27 07:56:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0792046fa70b505909ee00d0a6b4c5ee.jpg>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'city': 'Senago',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 102,
'expiration_date': '2026-04-28T15:29:26Z',
'fuel_type': 'petrol',
'id': '3164992b-d609-515d-8cbd-60be2bda6e77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH50726',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Suzuki',
'model': 'Jimny',
'odometer': 28388,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_2ec2751aef5f601d95ffa009e0fd7fc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0792046fa70b505909ee00d0a6b4c5ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_499af3a06a0affc8b08e6fcd2da7ca2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_37792c9b0b9012a71f9783d9f5d4417b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_d90cfa5d5cd9344354d228e91db06e1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81829,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_0bedcebe3adff2d18d764ba5d8389a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_079ca73ee82b75a28fcf0e334fec41ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_db14be5ec3715e54fe66876ce74c5d55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_f1be01ec592b56bfa68a9c987a597352.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3164992b-d609-515d-8cbd-60be2bda6e77/3164992b-d609-515d-8cbd-60be2bda6e77_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7a/ca/7acaab64153a7e7ec477bb617b7d38b8/pa/TH50726_cd6d6a6aa5f628f813c19c5df6200d2a.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2023-05-23',
'seats_number': 2,
'seller_name': None,
'title': 'Suzuki Jimny 1.5 ALLGRIP Pro',
'transmission': 'manual',
'trim': 'ALLGRIP Pro',
'year': 2023}
2026-04-27 07:56:46 [auto1.it] INFO: Saving data for TH50726: {'created_time': 1777276606.205582, 'last_price_update_time': 1777276606.205594, 'has_photos': True, 'auction_closing_time': 1777390166.0}
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5c974f66-d44d-5051-b9a8-b042763869b8 with identifier: UW74676
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5c974f66-d44d-5051-b9a8-b042763869b8 with identifier: UW74676
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5c974f66-d44d-5051-b9a8-b042763869b8 with identifier: UW74676 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_6a4e1c494f6995c9084391fc7b0cb7da.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': 'Rental',
'city': 'Milano',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:24:43Z',
'fuel_type': 'diesel',
'id': '5c974f66-d44d-5051-b9a8-b042763869b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW74676',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'BMW',
'model': 'X3',
'odometer': 197149,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_af7860405ad1508f1a1de3b46bdfe80e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_6a4e1c494f6995c9084391fc7b0cb7da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_bb3ca8d7db05b8998bfd6b381d95319f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_c441c00bd7211a57794b724ceda4fd73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_8a991d977ba24afc8d181dd417669173.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9cbee28ab8b6edd87cf835e1e87ea55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_a1a7ded3ca19044e1b06dbdb8d319726.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75200,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_de0aaa63c877cd19afc041ac2e989ac6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_fc8e5b2fc393abc5b0a217e4b486ce51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5c974f66-d44d-5051-b9a8-b042763869b8/5c974f66-d44d-5051-b9a8-b042763869b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgde/1f/de1f7654ccb27f746d57a275ff9226a5/pa/UW74676_9eaebc844a0fd3915dda0c620aa599ab.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-04-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 07:56:46 [auto1.it] INFO: Saving data for UW74676: {'created_time': 1777276606.543888, 'last_price_update_time': 1777276606.543898, 'has_photos': True, 'auction_closing_time': 1777389883.0}
2026-04-27 07:56:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with identifier: TD15526
2026-04-27 07:56:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with identifier: TD15526
2026-04-27 07:56:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ea856d6-1f16-5c8e-8988-33d7e449c2ba with identifier: TD15526 to the API
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_15836306f75927c91882cce546494c7d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 98,
'expiration_date': '2026-04-28T15:57:17Z',
'fuel_type': 'petrol',
'id': '6ea856d6-1f16-5c8e-8988-33d7e449c2ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD15526',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'MINI',
'model': 'MINI',
'odometer': 101360,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47858,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_da6bb7b4beeb9f82b1041667285d6224.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49244,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_15836306f75927c91882cce546494c7d.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47828,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_614db62e44c50af69627d56e1986e6ed.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35808,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_49f59ab4cd7a3ea27c30d303a7f59ecb.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43261,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_c5b35f168a969ec45c0d694938df24f6.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47547,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_17848373109699aaca90ee67f04f23e0.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43705,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_6113dd34f4dc1a7e121799393d5fceac.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_d2773b094387ee6793b823b67acc3a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51683,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_0ba9b244c37e63650d76d5866de96857.jpg',
'Width': 640},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ea856d6-1f16-5c8e-8988-33d7e449c2ba/6ea856d6-1f16-5c8e-8988-33d7e449c2ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42127,
'Height': 480,
'OriginUrl': 'https://img-pa.auto1.com/imgdc/65/dc659dbb8b754e49db73140ed1b9924f/pa/TD15526_5c61fc696bd9ee08229650a93afb888c.jpg',
'Width': 640}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2013-03-28',
'seats_number': 4,
'seller_name': None,
'title': 'MINI One',
'transmission': 'automatic',
'trim': '',
'year': 2013}
2026-04-27 07:56:46 [auto1.it] INFO: Saving data for TD15526: {'created_time': 1777276606.89598, 'last_price_update_time': 1777276606.895992, 'has_photos': True, 'auction_closing_time': 1777391837.0}
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56896d0>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f6c0ed0e19d1ecc1c46a7cb83cf3abfc.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57a8810>
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_738815cdd0eea046b0aa08e4f621b6a7.jpg saved to cache
2026-04-27 07:56:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_cb6ce6e24cc5343cc3a1bcd75289f389.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_9dc909dc6480f355ab70004957a0bbb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_1b275cf60c867081303bf0981220a899.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_2a1a8335d86459d6bfb97ed45db60fbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f7a0510b1759ade26728e385d82b6f37.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_da46b1945fbb7450bd2c90f17a5fbd75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_7e28eb0c1b23c01e4fb5e1d0a280d15d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_21504dd2adbe6fe43a60526454357858.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SV09218> (referer: https://www.auto1.com/v1/car-details-view/SV09218/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55b7410>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_37156ffc870100d888cb773439a7899a.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4f07698-d041-5127-8e18-563036465629
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4f07698-d041-5127-8e18-563036465629, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4f07698-d041-5127-8e18-563036465629 with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4f07698-d041-5127-8e18-563036465629 sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e4f07698-d041-5127-8e18-563036465629, identifier: GF55084
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55b6f10>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_440af1bd2cbdbfd5d076fcfc2064cd48.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7854b163-674a-5394-8c96-a46f13fbdef1
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7854b163-674a-5394-8c96-a46f13fbdef1, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7854b163-674a-5394-8c96-a46f13fbdef1 with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7854b163-674a-5394-8c96-a46f13fbdef1 sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7854b163-674a-5394-8c96-a46f13fbdef1, identifier: VK61820
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fc550>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_0a643c9a925474f4b95eaa97b0d92b8b.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1bff6203-ad4c-5cb1-a311-89c083b16a38
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1bff6203-ad4c-5cb1-a311-89c083b16a38, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1bff6203-ad4c-5cb1-a311-89c083b16a38 with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1bff6203-ad4c-5cb1-a311-89c083b16a38 sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1bff6203-ad4c-5cb1-a311-89c083b16a38, identifier: KC22557
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551ca50>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_190c59453aec32be601817b89e3c48e6.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d
2026-04-27 07:56:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75ac6fe8-c55e-547b-a55a-d66de9c3773d, skipping ID generation
2026-04-27 07:56:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d with scrape type 1
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75ac6fe8-c55e-547b-a55a-d66de9c3773d sending to next pipeline
2026-04-27 07:56:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 75ac6fe8-c55e-547b-a55a-d66de9c3773d, identifier: AT32399
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53ba010>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_681213f8c109cbdf64719e2bf0d5c82e.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64d8690>
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_467f4ea6a519ec70731cad5270b62ba4.jpg saved to cache
2026-04-27 07:56:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e4f07698-d041-5127-8e18-563036465629 with identifier: GF55084
2026-04-27 07:56:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e4f07698-d041-5127-8e18-563036465629 with identifier: GF55084
2026-04-27 07:56:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e4f07698-d041-5127-8e18-563036465629 with identifier: GF55084 to the API
2026-04-27 07:56:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_37156ffc870100d888cb773439a7899a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'city': 'Brugherio',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-04-28T15:09:15Z',
'fuel_type': 'petrol',
'id': 'e4f07698-d041-5127-8e18-563036465629',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.553,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GF55084',
'listing': 'auction',
'location': 'IT, Brugherio',
'location_confidence': 'geocoded',
'longitude': 9.2991,
'make': 'Opel',
'model': 'Corsa',
'odometer': 45720,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0febfa0db587058fb3ce61de24b97f11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94444,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_37156ffc870100d888cb773439a7899a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100088,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_daede09d8d8c5ccaaea0467284f4f155.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_0fddce3f632a6d564bffc7b17a093efa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96072,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_309b251f978d548c25122a6241660e99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_880ed91a524c5f54907070b1f922c1fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_8dad89fc4e91307790fe8d4a96b49738.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_545bc602c245ea4a055d27f98632ec50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_74118885ead38faf5c51b1f9c9ec4b5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e4f07698-d041-5127-8e18-563036465629/e4f07698-d041-5127-8e18-563036465629_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/f7/fff7ed0df5fcb87e2bb208ccbc819ffb/pa/GF55084_4526be66489b0981454b5f69262a31ac.jpg',
'Width': 800}],
'postal_code': '20861',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2021-03-25',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Turbo Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2021}
2026-04-27 07:56:48 [auto1.it] INFO: Saving data for GF55084: {'created_time': 1777276608.181083, 'last_price_update_time': 1777276608.181095, 'has_photos': True, 'auction_closing_time': 1777388955.0}
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7854b163-674a-5394-8c96-a46f13fbdef1 with identifier: VK61820
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7854b163-674a-5394-8c96-a46f13fbdef1 with identifier: VK61820
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7854b163-674a-5394-8c96-a46f13fbdef1 with identifier: VK61820 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_440af1bd2cbdbfd5d076fcfc2064cd48.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'city': 'Roma',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:20:32Z',
'fuel_type': 'diesel',
'id': '7854b163-674a-5394-8c96-a46f13fbdef1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VK61820',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'MINI',
'model': 'Countryman',
'odometer': 138376,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_6e3ff514fbdc424cadcf2b2f161ad66f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f6c0ed0e19d1ecc1c46a7cb83cf3abfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_440af1bd2cbdbfd5d076fcfc2064cd48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_fd35ec30a038e22301dd06a994ccaa6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71602,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_3a69d268bd1dcf9d0d45bca28c4fb1fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_f07e441fa0fb666f4729f27a6de57494.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81632,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_10b6496d1de2426eb843b916c29fe6c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_2d0c9675b9b3fb55fabd93a4e54c48a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_38c132548885391dfb6a857f24899208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7854b163-674a-5394-8c96-a46f13fbdef1/7854b163-674a-5394-8c96-a46f13fbdef1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/bb/fbbb8e466ee3f668b2cf99fab740dcb5/pa/VK61820_52d00dd180a8b2ac2d26ae139e71bc5c.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2014-10-29',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper D ALL4',
'transmission': 'automatic',
'trim': 'ALL4',
'year': 2014}
2026-04-27 07:56:48 [auto1.it] INFO: Saving data for VK61820: {'created_time': 1777276608.668787, 'last_price_update_time': 1777276608.668796, 'has_photos': True, 'auction_closing_time': 1777389632.0}
2026-04-27 07:56:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1bff6203-ad4c-5cb1-a311-89c083b16a38 with identifier: KC22557
2026-04-27 07:56:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1bff6203-ad4c-5cb1-a311-89c083b16a38 with identifier: KC22557
2026-04-27 07:56:48 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1bff6203-ad4c-5cb1-a311-89c083b16a38 with identifier: KC22557 to the API
2026-04-27 07:56:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_0a643c9a925474f4b95eaa97b0d92b8b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 283,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'blue',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '3.8L',
'engine_horse_power': 355,
'expiration_date': '2026-04-28T15:49:51Z',
'fuel_type': 'petrol',
'id': '1bff6203-ad4c-5cb1-a311-89c083b16a38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC22557',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Porsche',
'model': '911',
'odometer': 150492,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_23454dbefe9fd9d4c56aac979b2f8d65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_0a643c9a925474f4b95eaa97b0d92b8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_4cff64b288c3910732eb1d0846bdb1e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c9e065bdccdd7426c19c0fbdc0c32274.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_c0fb631f3d764de0b85e011c74c6bb35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_024247b01673fb8f7ebf8563643ca46d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_403dd5cef145ad82de61f7ea4ce133f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_9d09ddce4e118416f99fd9b3ae9eb2af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_d133ff0c765ec80a2f98c4385ab2f32b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1bff6203-ad4c-5cb1-a311-89c083b16a38/1bff6203-ad4c-5cb1-a311-89c083b16a38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/af/ebafc03ba85dcbf4ae819e27e36cd638/pa/KC22557_e4dd7fece97f4b47fce0a98c5345a0bc.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2005-01-17',
'seats_number': 4,
'seller_name': None,
'title': 'Porsche 911 997 Carrera S',
'transmission': 'automatic',
'trim': 'Carrera S',
'year': 2005}
2026-04-27 07:56:49 [auto1.it] INFO: Saving data for KC22557: {'created_time': 1777276609.154249, 'last_price_update_time': 1777276609.15426, 'has_photos': True, 'auction_closing_time': 1777391391.0}
2026-04-27 07:56:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 75ac6fe8-c55e-547b-a55a-d66de9c3773d with identifier: AT32399
2026-04-27 07:56:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 75ac6fe8-c55e-547b-a55a-d66de9c3773d with identifier: AT32399
2026-04-27 07:56:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 75ac6fe8-c55e-547b-a55a-d66de9c3773d with identifier: AT32399 to the API
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_190c59453aec32be601817b89e3c48e6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'Varedo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:49:27Z',
'fuel_type': 'diesel',
'id': '75ac6fe8-c55e-547b-a55a-d66de9c3773d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AT32399',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'BMW',
'model': 'X3',
'odometer': 137150,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_1dd45a8c0cb3b5eaed691da617c742b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f979063e0808d205898dfcf6d962df52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_9db3b975608d64aa247850d07b053438.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_17017d459fbe5e6c95309e8915ac72a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_f1265c619acd332047be48f6a0d62c7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_b00aebc8ffe59db70e4ce76786bd08e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64732,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_90e6cb39a3774dbb72fffa151892275f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_190c59453aec32be601817b89e3c48e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_bdfd86abebea728e7cc7734f659072fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_75ac6fe8-c55e-547b-a55a-d66de9c3773d/75ac6fe8-c55e-547b-a55a-d66de9c3773d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/c7/e3c7aa7599ad14f12eab0779aa68c232/pa/AT32399_022b9414fd7feff38b56a774445bccc1.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2014-10-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 20d',
'transmission': 'automatic',
'trim': '',
'year': 2014}
2026-04-27 07:56:49 [auto1.it] INFO: Saving data for AT32399: {'created_time': 1777276609.55417, 'last_price_update_time': 1777276609.554178, 'has_photos': True, 'auction_closing_time': 1777391367.0}
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_14f4ddd04d3a7360abca3c3f169f5739.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f2260174855e81c00593dfea5119eeaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b4d0>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_cb6ce6e24cc5343cc3a1bcd75289f389.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58bb550>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_9dc909dc6480f355ab70004957a0bbb7.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c3310>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_1b275cf60c867081303bf0981220a899.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dd9a583-b2c9-5c02-b367-8953999758dc
2026-04-27 07:56:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dd9a583-b2c9-5c02-b367-8953999758dc, skipping ID generation
2026-04-27 07:56:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dd9a583-b2c9-5c02-b367-8953999758dc with scrape type 1
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dd9a583-b2c9-5c02-b367-8953999758dc sending to next pipeline
2026-04-27 07:56:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9dd9a583-b2c9-5c02-b367-8953999758dc, identifier: LZ09270
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b8f10>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_2a1a8335d86459d6bfb97ed45db60fbc.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58fa510>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f7a0510b1759ade26728e385d82b6f37.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c3150>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_da46b1945fbb7450bd2c90f17a5fbd75.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c3b90>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_7e28eb0c1b23c01e4fb5e1d0a280d15d.jpg saved to cache
2026-04-27 07:56:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53a8750>
2026-04-27 07:56:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_21504dd2adbe6fe43a60526454357858.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70817c73-ad5f-513e-a543-21c17dd1ca6e
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70817c73-ad5f-513e-a543-21c17dd1ca6e, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70817c73-ad5f-513e-a543-21c17dd1ca6e with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70817c73-ad5f-513e-a543-21c17dd1ca6e sending to next pipeline
2026-04-27 07:56:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 70817c73-ad5f-513e-a543-21c17dd1ca6e, identifier: HD90856
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e38161a-7438-5add-a856-20d711f90896 with identifier: SV09218
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e38161a-7438-5add-a856-20d711f90896 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_da4671041d50d01bcf8806f04de22b6c.jpg not downloaded yet
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9dd9a583-b2c9-5c02-b367-8953999758dc with identifier: LZ09270
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9dd9a583-b2c9-5c02-b367-8953999758dc with identifier: LZ09270
2026-04-27 07:56:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9dd9a583-b2c9-5c02-b367-8953999758dc with identifier: LZ09270 to the API
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_1b275cf60c867081303bf0981220a899.jpg>
{'auction_title': '',
'c_o_2_emission_value': 89,
'category': None,
'city': 'Varedo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:20:19Z',
'fuel_type': 'diesel',
'id': '9dd9a583-b2c9-5c02-b367-8953999758dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LZ09270',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Volvo',
'model': 'V40',
'odometer': 179016,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_1b275cf60c867081303bf0981220a899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_bd6bcaf39a7f14a95307c22d6a220a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_681213f8c109cbdf64719e2bf0d5c82e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_43a60c37082f606296566448fc5572b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_27a7a416abd7094fa341ffbdca214ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118522,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_f563a05c876a5fbca88b2f7969c5cfbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_36b9454d9e04cccb0451c03d1cd6c8f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_03360838fc07ad15ce30318a23565881.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3de2c0063ce355d9da153ae66750eee8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9dd9a583-b2c9-5c02-b367-8953999758dc/9dd9a583-b2c9-5c02-b367-8953999758dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/0b/d60b6267e6e8aac0112f214159ff68f9/pa/LZ09270_3c4eaa31b984127d55709e0b473cc30b.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2017-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V40 2.0 D2 Kinetic',
'transmission': 'manual',
'trim': 'Kinetic',
'year': 2017}
2026-04-27 07:56:50 [auto1.it] INFO: Saving data for LZ09270: {'created_time': 1777276610.52764, 'last_price_update_time': 1777276610.527652, 'has_photos': True, 'auction_closing_time': 1777389619.0}
2026-04-27 07:56:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 70817c73-ad5f-513e-a543-21c17dd1ca6e with identifier: HD90856
2026-04-27 07:56:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 70817c73-ad5f-513e-a543-21c17dd1ca6e with identifier: HD90856
2026-04-27 07:56:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 70817c73-ad5f-513e-a543-21c17dd1ca6e with identifier: HD90856 to the API
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_21504dd2adbe6fe43a60526454357858.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Varedo',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:58:08Z',
'fuel_type': 'petrol',
'id': '70817c73-ad5f-513e-a543-21c17dd1ca6e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD90856',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Peugeot',
'model': '208',
'odometer': 130512,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_2a1a8335d86459d6bfb97ed45db60fbc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_21504dd2adbe6fe43a60526454357858.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_9dc909dc6480f355ab70004957a0bbb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_be7e83a3f68da51b876aecf1e49cfaa3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_3d264b6688bcc39366673db25acb246c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_c79385ceccfa1cb98a587c8fe5beb8f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_63a72991318063d890ddc9cbecb30ab2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_00cd6147c18aa6da1acdc794daf3fbee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_99a671efc06312e0be7f97793519cc6d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_70817c73-ad5f-513e-a543-21c17dd1ca6e/70817c73-ad5f-513e-a543-21c17dd1ca6e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/f0/92f0a2ddd330f55e12fa4979ed5478f7/pa/HD90856_f9134100fba6ac2bc825804d8ab7fd2e.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 07:56:50 [auto1.it] INFO: Saving data for HD90856: {'created_time': 1777276610.866964, 'last_price_update_time': 1777276610.866974, 'has_photos': True, 'auction_closing_time': 1777391888.0}
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_0cca192f0ab0bc5ee3de6794ed78d5e5.jpg not downloaded yet
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VS63057/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UX19423/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EW44732> (referer: https://www.auto1.com/v1/car-details-view/EW44732/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AY32045> (referer: https://www.auto1.com/v1/car-details-view/AY32045/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB63446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a03410>
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_14f4ddd04d3a7360abca3c3f169f5739.jpg saved to cache
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2
2026-04-27 07:56:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c4421fb-d19d-5b20-922f-db6721d3e5b2, skipping ID generation
2026-04-27 07:56:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with scrape type 1
2026-04-27 07:56:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c4421fb-d19d-5b20-922f-db6721d3e5b2 sending to next pipeline
2026-04-27 07:56:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c4421fb-d19d-5b20-922f-db6721d3e5b2, identifier: NT74531
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551b410>
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f2260174855e81c00593dfea5119eeaf.jpg saved to cache
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17
2026-04-27 07:56:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17, skipping ID generation
2026-04-27 07:56:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with scrape type 1
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 sending to next pipeline
2026-04-27 07:56:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17, identifier: SA42409
2026-04-27 07:56:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_be4bbc964457427fc77c845bcf2d3cdc.jpg not downloaded yet
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with identifier: NT74531
2026-04-27 07:56:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with identifier: NT74531
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c4421fb-d19d-5b20-922f-db6721d3e5b2 with identifier: NT74531 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_14f4ddd04d3a7360abca3c3f169f5739.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:04:29Z',
'fuel_type': 'petrol',
'id': '6c4421fb-d19d-5b20-922f-db6721d3e5b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT74531',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Opel',
'model': 'Corsa',
'odometer': 117872,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_14f4ddd04d3a7360abca3c3f169f5739.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78230,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_7e28eb0c1b23c01e4fb5e1d0a280d15d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_cb6ce6e24cc5343cc3a1bcd75289f389.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_467f4ea6a519ec70731cad5270b62ba4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c4421fb-d19d-5b20-922f-db6721d3e5b2/6c4421fb-d19d-5b20-922f-db6721d3e5b2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/76/eb768da11741892887f8c718d2b088f8/pa/NT74531_dc2f092f8f22c6f52c04f623fef979b2.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2013-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2013}
2026-04-27 07:56:51 [auto1.it] INFO: Saving data for NT74531: {'created_time': 1777276611.6438, 'last_price_update_time': 1777276611.643811, 'has_photos': True, 'auction_closing_time': 1777388669.0}
2026-04-27 07:56:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with identifier: SA42409
2026-04-27 07:56:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with identifier: SA42409
2026-04-27 07:56:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f618f04-a60d-5ea9-b1f7-6c09b6d74d17 with identifier: SA42409 to the API
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f2260174855e81c00593dfea5119eeaf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-04-28T15:22:09Z',
'fuel_type': 'petrol',
'id': '8f618f04-a60d-5ea9-b1f7-6c09b6d74d17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SA42409',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Fiat',
'model': 'Panda',
'odometer': 5878,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f2260174855e81c00593dfea5119eeaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_da46b1945fbb7450bd2c90f17a5fbd75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_f7a0510b1759ade26728e385d82b6f37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63654,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_738815cdd0eea046b0aa08e4f621b6a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_cb433cef03bec587bfb99c9fb7269cd8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_a302ec55f63cc432d4ecee6461c9dacc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63660,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_75a3be19ef5cfe5a4258fd11ff095bee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_c3b0ee0c22cebd084ca7a5e6b182c050.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_5dd69425d792fa213ce7116c38f3686e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f618f04-a60d-5ea9-b1f7-6c09b6d74d17/8f618f04-a60d-5ea9-b1f7-6c09b6d74d17_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69962,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6f/6e/6f6e0c9fb81507a4c6aaecaf7655d0b2/pa/SA42409_8517a997db6953cf6f6e19fa45d94217.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2025-01-14',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2025}
2026-04-27 07:56:52 [auto1.it] INFO: Saving data for SA42409: {'created_time': 1777276612.087545, 'last_price_update_time': 1777276612.087556, 'has_photos': True, 'auction_closing_time': 1777389729.0}
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_526050451e1c596b5c5fdac451cca6a1.jpg not downloaded yet
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LG98930/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_d5e5d9927347ae1ea66aa9c807be2baf.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a65f9e7-6410-5059-b705-1f85c0eabc90 with identifier: EW44732
2026-04-27 07:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a65f9e7-6410-5059-b705-1f85c0eabc90 with scrape type 1
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_f713e50871b5f1fde3d6c3a78b854fcc.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3ec9548-68b3-5841-b794-277ed138a0ee with identifier: AY32045
2026-04-27 07:56:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ec9548-68b3-5841-b794-277ed138a0ee with scrape type 1
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_1040c9dea58e85152553dacd10968d18.jpg not downloaded yet
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_da4671041d50d01bcf8806f04de22b6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_0cca192f0ab0bc5ee3de6794ed78d5e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_7ed43b7299b83573e9d054b27ed939d7.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_253bdb429b35866a8a5f63179044baec.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_40f7c09eae59caa70d34462ed15d464a.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_dbf58ac6bbd166f56dc93e3e1568d52b.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1d21728d0867a5d47ae855c650a5bbed.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_b329eb165c057796e7eca69af3442459.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_4953d5abd706ecccc609117621c5bee5.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_e4835cad62442ee8c7ee4634f6fa6ac5.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_f6ba003f3003d4b73bf032c646dfb070.jpg not downloaded yet
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c3690>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_da4671041d50d01bcf8806f04de22b6c.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64d89d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_0cca192f0ab0bc5ee3de6794ed78d5e5.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_526050451e1c596b5c5fdac451cca6a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_f308132760de64042895983ff70c04bb.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_dfde8a1280bda71383862410670a0bd4.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_d569ea0fa452e8d550fd0f73fbbee678.jpg not downloaded yet
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_1040c9dea58e85152553dacd10968d18.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_fbe088aa4f385e82097aa4607feb0a6d.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_9ddf65ea5d3ed482528bf7b598d35d49.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_06259301172198025fab841cefcc1b21.jpg not downloaded yet
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1cf98cea73628c772c76b4dbdc8a7fc6.jpg not downloaded yet
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GV61096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7c890>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_526050451e1c596b5c5fdac451cca6a1.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_711eb0b27de5da7ce905da7dd9ed9e8f.jpg not downloaded yet
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_951aa256c64d99732b9bbc8020928c71.jpg not downloaded yet
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZV11200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ce590>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_1040c9dea58e85152553dacd10968d18.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_e4835cad62442ee8c7ee4634f6fa6ac5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_f6ba003f3003d4b73bf032c646dfb070.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a03f50>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_e4835cad62442ee8c7ee4634f6fa6ac5.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FX34637/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XV36287/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1cf98cea73628c772c76b4dbdc8a7fc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a009d0>
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_f6ba003f3003d4b73bf032c646dfb070.jpg saved to cache
2026-04-27 07:56:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_711eb0b27de5da7ce905da7dd9ed9e8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_951aa256c64d99732b9bbc8020928c71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571fb10>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1cf98cea73628c772c76b4dbdc8a7fc6.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_d569ea0fa452e8d550fd0f73fbbee678.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GR59213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571eb90>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_711eb0b27de5da7ce905da7dd9ed9e8f.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_9ddf65ea5d3ed482528bf7b598d35d49.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_06259301172198025fab841cefcc1b21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_fbe088aa4f385e82097aa4607feb0a6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HH85669/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564f290>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_951aa256c64d99732b9bbc8020928c71.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad2d0>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_d569ea0fa452e8d550fd0f73fbbee678.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_f308132760de64042895983ff70c04bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LU21739/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af5d90>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_9ddf65ea5d3ed482528bf7b598d35d49.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c0150>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_06259301172198025fab841cefcc1b21.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab9d10>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_fbe088aa4f385e82097aa4607feb0a6d.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_dfde8a1280bda71383862410670a0bd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_4953d5abd706ecccc609117621c5bee5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b2350>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_f308132760de64042895983ff70c04bb.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2cc50>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_dfde8a1280bda71383862410670a0bd4.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fff90>
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_4953d5abd706ecccc609117621c5bee5.jpg saved to cache
2026-04-27 07:56:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK33610/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_b329eb165c057796e7eca69af3442459.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1d21728d0867a5d47ae855c650a5bbed.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KC73163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT21466/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YP09889/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6590650>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_b329eb165c057796e7eca69af3442459.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_40f7c09eae59caa70d34462ed15d464a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VT66321/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5837f50>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1d21728d0867a5d47ae855c650a5bbed.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_dbf58ac6bbd166f56dc93e3e1568d52b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_7ed43b7299b83573e9d054b27ed939d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53991d0>
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_40f7c09eae59caa70d34462ed15d464a.jpg saved to cache
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3ec9548-68b3-5841-b794-277ed138a0ee
2026-04-27 07:56:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3ec9548-68b3-5841-b794-277ed138a0ee, skipping ID generation
2026-04-27 07:56:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3ec9548-68b3-5841-b794-277ed138a0ee with scrape type 1
2026-04-27 07:56:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3ec9548-68b3-5841-b794-277ed138a0ee sending to next pipeline
2026-04-27 07:56:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d3ec9548-68b3-5841-b794-277ed138a0ee, identifier: AY32045
2026-04-27 07:56:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d3ec9548-68b3-5841-b794-277ed138a0ee with identifier: AY32045
2026-04-27 07:56:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d3ec9548-68b3-5841-b794-277ed138a0ee with identifier: AY32045
2026-04-27 07:56:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d3ec9548-68b3-5841-b794-277ed138a0ee with identifier: AY32045 to the API
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_40f7c09eae59caa70d34462ed15d464a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:58:50Z',
'fuel_type': 'diesel',
'id': 'd3ec9548-68b3-5841-b794-277ed138a0ee',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY32045',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Peugeot',
'model': '308',
'odometer': 219923,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82900,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_1040c9dea58e85152553dacd10968d18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_40f7c09eae59caa70d34462ed15d464a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_b329eb165c057796e7eca69af3442459.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_f6ba003f3003d4b73bf032c646dfb070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d3ec9548-68b3-5841-b794-277ed138a0ee/d3ec9548-68b3-5841-b794-277ed138a0ee_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2c/66/2c662ad7c5be9d90b70279389d075294/pa/AY32045_d569ea0fa452e8d550fd0f73fbbee678.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2010-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 2.0 HDi Feline',
'transmission': 'manual',
'trim': 'Feline',
'year': 2010}
2026-04-27 07:56:54 [auto1.it] INFO: Saving data for AY32045: {'created_time': 1777276614.96472, 'last_price_update_time': 1777276614.964729, 'has_photos': True, 'auction_closing_time': 1777391930.0}
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_253bdb429b35866a8a5f63179044baec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_f713e50871b5f1fde3d6c3a78b854fcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GV61096> (referer: https://www.auto1.com/v1/car-details-view/GV61096/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB63446> (referer: https://www.auto1.com/v1/car-details-view/AB63446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZV11200> (referer: https://www.auto1.com/v1/car-details-view/ZV11200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AF81201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5399990>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_dbf58ac6bbd166f56dc93e3e1568d52b.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a4fd0>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_7ed43b7299b83573e9d054b27ed939d7.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65bb4d0>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_253bdb429b35866a8a5f63179044baec.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645c150>
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_f713e50871b5f1fde3d6c3a78b854fcc.jpg saved to cache
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a65f9e7-6410-5059-b705-1f85c0eabc90
2026-04-27 07:56:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a65f9e7-6410-5059-b705-1f85c0eabc90, skipping ID generation
2026-04-27 07:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a65f9e7-6410-5059-b705-1f85c0eabc90 with scrape type 1
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a65f9e7-6410-5059-b705-1f85c0eabc90 sending to next pipeline
2026-04-27 07:56:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7a65f9e7-6410-5059-b705-1f85c0eabc90, identifier: EW44732
2026-04-27 07:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-04-27 07:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d5133-0395-5de4-8feb-3487264009cc with scrape type 1
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with identifier: AB63446
2026-04-27 07:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with scrape type 1
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bf16aa83d660e39c67835eb193b0e311.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-04-27 07:56:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 1
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_1fb0da3985c33b431146b692adff1489.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7a65f9e7-6410-5059-b705-1f85c0eabc90 with identifier: EW44732
2026-04-27 07:56:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7a65f9e7-6410-5059-b705-1f85c0eabc90 with identifier: EW44732
2026-04-27 07:56:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7a65f9e7-6410-5059-b705-1f85c0eabc90 with identifier: EW44732 to the API
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_f713e50871b5f1fde3d6c3a78b854fcc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 177,
'category': None,
'city': 'Roma',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:46:00Z',
'fuel_type': 'diesel',
'id': '7a65f9e7-6410-5059-b705-1f85c0eabc90',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW44732',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 120312,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_f713e50871b5f1fde3d6c3a78b854fcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77604,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_253bdb429b35866a8a5f63179044baec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1d21728d0867a5d47ae855c650a5bbed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71520,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_e4835cad62442ee8c7ee4634f6fa6ac5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82429,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_dfde8a1280bda71383862410670a0bd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_9ddf65ea5d3ed482528bf7b598d35d49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_06259301172198025fab841cefcc1b21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_1cf98cea73628c772c76b4dbdc8a7fc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_711eb0b27de5da7ce905da7dd9ed9e8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7a65f9e7-6410-5059-b705-1f85c0eabc90/7a65f9e7-6410-5059-b705-1f85c0eabc90_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img17/66/176619d1f5f0f7579ca77728c20d8f60/pa/EW44732_951aa256c64d99732b9bbc8020928c71.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2010-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 2.0 dCi Visia 4x4',
'transmission': 'manual',
'trim': 'Visia 4x4',
'year': 2010}
2026-04-27 07:56:55 [auto1.it] INFO: Saving data for EW44732: {'created_time': 1777276615.886155, 'last_price_update_time': 1777276615.886166, 'has_photos': True, 'auction_closing_time': 1777391160.0}
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_d5e5d9927347ae1ea66aa9c807be2baf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_be4bbc964457427fc77c845bcf2d3cdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_a8904aebe94432b8df95e53d7e8c6a96.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7901b73886e760853dbea17cf374deb1.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg not downloaded yet
2026-04-27 07:56:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bb12930c9b8ef570da97d3027583105d.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_74b3ddd19887733b7b6585619f66b7b6.jpg not downloaded yet
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GR59213> (referer: https://www.auto1.com/v1/car-details-view/GR59213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LG98930> (referer: https://www.auto1.com/v1/car-details-view/LG98930/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_71efec5884670cf7053e99e958d7d48c.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ce129fe4f1469d18bef01b681a0b94c4.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_ae9beccfb1acaa342d4ce4483e7d7ac5.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_407ee3ee29789511e79eb94b87f71c39.jpg not downloaded yet
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5528b90>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_d5e5d9927347ae1ea66aa9c807be2baf.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_1fb0da3985c33b431146b692adff1489.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg not downloaded yet
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_fbabbe6f181026294001c74350466250.jpg not downloaded yet
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a7f890>
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_be4bbc964457427fc77c845bcf2d3cdc.jpg saved to cache
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e38161a-7438-5add-a856-20d711f90896
2026-04-27 07:56:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e38161a-7438-5add-a856-20d711f90896, skipping ID generation
2026-04-27 07:56:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e38161a-7438-5add-a856-20d711f90896 with scrape type 1
2026-04-27 07:56:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e38161a-7438-5add-a856-20d711f90896 sending to next pipeline
2026-04-27 07:56:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e38161a-7438-5add-a856-20d711f90896, identifier: SV09218
2026-04-27 07:56:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7901b73886e760853dbea17cf374deb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e38161a-7438-5add-a856-20d711f90896 with identifier: SV09218
2026-04-27 07:56:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e38161a-7438-5add-a856-20d711f90896 with identifier: SV09218
2026-04-27 07:56:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:56:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e38161a-7438-5add-a856-20d711f90896 with identifier: SV09218 to the API
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:56:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:56:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_be4bbc964457427fc77c845bcf2d3cdc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Reggio Emilia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:10:18Z',
'fuel_type': 'diesel',
'id': '3e38161a-7438-5add-a856-20d711f90896',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV09218',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 138922,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_da4671041d50d01bcf8806f04de22b6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61856,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_0cca192f0ab0bc5ee3de6794ed78d5e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58974,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_be4bbc964457427fc77c845bcf2d3cdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_526050451e1c596b5c5fdac451cca6a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_d5e5d9927347ae1ea66aa9c807be2baf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_7ed43b7299b83573e9d054b27ed939d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46813,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_dbf58ac6bbd166f56dc93e3e1568d52b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_4953d5abd706ecccc609117621c5bee5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_f308132760de64042895983ff70c04bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e38161a-7438-5add-a856-20d711f90896/3e38161a-7438-5add-a856-20d711f90896_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56290,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/a8/9aa8b0c9b292c279d2ebb60ac4a7df13/pa/SV09218_fbe088aa4f385e82097aa4607feb0a6d.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2015-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 CDI BlueEfficiency Executive',
'transmission': 'manual',
'trim': 'BlueEfficiency Executive',
'year': 2015}
2026-04-27 07:56:57 [auto1.it] INFO: Saving data for SV09218: {'created_time': 1777276617.129325, 'last_price_update_time': 1777276617.129365, 'has_photos': True, 'auction_closing_time': 1777389018.0}
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ebf47de927fb00d43939ef19fb0ba6e2.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5e81249-bc88-5a5e-87bd-556c5156c372 with identifier: GR59213
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e81249-bc88-5a5e-87bd-556c5156c372 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5b9f8022eebdbafc095e7a0d08a021be.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with identifier: LG98930
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cc344ba55311e021bcd9fe607ac096d.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_a8904aebe94432b8df95e53d7e8c6a96.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64580d0>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_1fb0da3985c33b431146b692adff1489.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_977019eec6b3666779715f935a8523d0.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5ae52c6418eb6e993aa8c906dac9255f.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_5b314b33581f6627d986e1e3ba7ae025.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HH85669> (referer: https://www.auto1.com/v1/car-details-view/HH85669/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LU21739> (referer: https://www.auto1.com/v1/car-details-view/LU21739/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FX34637> (referer: https://www.auto1.com/v1/car-details-view/FX34637/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UX19423> (referer: https://www.auto1.com/v1/car-details-view/UX19423/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53a3910>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7901b73886e760853dbea17cf374deb1.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_8d66057615d7de2773d3c9ccd786b7f0.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_83b600bb03efe010001a9f202e399d57.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cb20b8afc8ea20b39d476b7f1ecb2e3.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_407ee3ee29789511e79eb94b87f71c39.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XV36287> (referer: https://www.auto1.com/v1/car-details-view/XV36287/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64818d0>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_a8904aebe94432b8df95e53d7e8c6a96.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_ae9beccfb1acaa342d4ce4483e7d7ac5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7e3f5f37b2f0c020c8de725aa78e3b42.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_20238bdf985293b8c32d8eb040a9f367.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_f3832417b95c31ae554cbfbb93099c6d.png not downloaded yet
2026-04-27 07:56:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 17445644-936d-5071-a996-c16e7ed871f2 with identifier: HH85669
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17445644-936d-5071-a996-c16e7ed871f2 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_40a4848df3947bec22359dacac611246.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831b0cd3-f677-56db-bb13-ebfbcc80c122 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_14e11bbeb509c1cef5c1ad870c882031.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with identifier: FX34637
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_111dadf7520182b4aeef431094716a4f.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8a25cc-3da0-5730-9474-582023b076cb with identifier: UX19423
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8a25cc-3da0-5730-9474-582023b076cb with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_b71db49e205d7b9b25703dbc00aca300.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cc344ba55311e021bcd9fe607ac096d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5b9f8022eebdbafc095e7a0d08a021be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_0777da29987b5e2fd72a2f49e1026ea3.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_e073584cee5ceff2a0cab18a57c16702.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ebf47de927fb00d43939ef19fb0ba6e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_fbabbe6f181026294001c74350466250.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_22ba3793b2b9fc3f75c23b85255c1213.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_28d5f09b3cf1a00d9ab5b160e53d1166.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_f71599ff987b39e9f81be411c7bdf956.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_233eaabe00cb6925f93f4ab9709587d1.jpg not downloaded yet
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b9590>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_407ee3ee29789511e79eb94b87f71c39.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f632eafe-7fe9-5ce6-a445-cb029e3ed436 with identifier: XV36287
2026-04-27 07:56:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f632eafe-7fe9-5ce6-a445-cb029e3ed436 with scrape type 1
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a7bdb82b14ca078495a6ec2184265ca8.jpg not downloaded yet
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_d555028f77aeedfa2e9f2216923ace64.jpg not downloaded yet
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dcb50>
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_ae9beccfb1acaa342d4ce4483e7d7ac5.jpg saved to cache
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:56:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_83b600bb03efe010001a9f202e399d57.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_94c02cef0e2eced1ab5ca7b66fc6e62f.jpg not downloaded yet
2026-04-27 07:56:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_5879ad653c61374245415aef0e8a60fb.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_046c88cfe42fbffa49f505024122b18a.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_68992607bc996335b0190988c61663ef.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_325513026efd0c0ee46e059fc42d7531.jpg not downloaded yet
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_5b314b33581f6627d986e1e3ba7ae025.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cb20b8afc8ea20b39d476b7f1ecb2e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_a316a9bed73652627e5f310f5d347e92.jpg not downloaded yet
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5689290>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cc344ba55311e021bcd9fe607ac096d.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58da610>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5b9f8022eebdbafc095e7a0d08a021be.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead558cdd0>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ebf47de927fb00d43939ef19fb0ba6e2.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bc190>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_fbabbe6f181026294001c74350466250.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_b71db49e205d7b9b25703dbc00aca300.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_20238bdf985293b8c32d8eb040a9f367.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_d3f8c7c632fe4a92bb600493ee097852.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_1d3f2918a0d862aff5a73301ca924d99.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d0440051b479d2ac263e48a663238556.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_70d28570edbfef364b08457fedcde08a.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a034843d29537b69261899aff6eba98e.jpg not downloaded yet
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_e073584cee5ceff2a0cab18a57c16702.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_111dadf7520182b4aeef431094716a4f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_cb16d489ea7969b98c7ff38def6da19e.jpg not downloaded yet
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5820ed0>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5456e90>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_83b600bb03efe010001a9f202e399d57.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b9c1eb31556bbbad5993ad75912ba59e.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_7fe9bf54b0854bb699cafdbddfefb573.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_a8abf693f092d51271b434c9734a7d08.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_ab70d21bed6c59b4291a298abb17f1e3.jpg not downloaded yet
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_eb4e9f86c0e455efdef3264acc6f262d.jpg not downloaded yet
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YP09889> (referer: https://www.auto1.com/v1/car-details-view/YP09889/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK33610> (referer: https://www.auto1.com/v1/car-details-view/PK33610/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53a3150>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_5b314b33581f6627d986e1e3ba7ae025.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5454990>
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cb20b8afc8ea20b39d476b7f1ecb2e3.jpg saved to cache
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a7bdb82b14ca078495a6ec2184265ca8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_c6ad0c248a2271de0eeefd2f8ffb27f4.jpg not downloaded yet
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_f3832417b95c31ae554cbfbb93099c6d.png> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_233eaabe00cb6925f93f4ab9709587d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_68992607bc996335b0190988c61663ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_d555028f77aeedfa2e9f2216923ace64.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_3b2e456a56575235aed1547b3347891a.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_318af37c61a9a6a402ab959b62516a88.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_2f65b2063b15f40ecaee979855f94853.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_af457bba7d21823ef086e481ed207812.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_12e092016e378268bbba61a2ce5c9b20.jpg not downloaded yet
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5730c50>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_b71db49e205d7b9b25703dbc00aca300.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65bac50>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_20238bdf985293b8c32d8eb040a9f367.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c1610>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_e073584cee5ceff2a0cab18a57c16702.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c34d0>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_111dadf7520182b4aeef431094716a4f.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_325513026efd0c0ee46e059fc42d7531.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_423bea972b7264a094fcb67886138294.jpg not downloaded yet
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_a316a9bed73652627e5f310f5d347e92.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_046c88cfe42fbffa49f505024122b18a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_19c9a0eb39dcf22b71377f32b10f19a7.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_bcf16e2642b750e476032a6de17c86ae.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_8f84213ef103e0ec2b0496ad8fb872dc.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_44aaaf5d63289cc8c8688ba24062d3c8.jpg not downloaded yet
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT05418/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VS63057> (referer: https://www.auto1.com/v1/car-details-view/VS63057/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KC73163> (referer: https://www.auto1.com/v1/car-details-view/KC73163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PV47203/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AF81201> (referer: https://www.auto1.com/v1/car-details-view/AF81201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1860f3b3-5adb-5ab6-8cba-928e37752d6d with identifier: YP09889
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d with scrape type 1
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_19c470b613a6d8c1b13b429f368b2838.jpg not downloaded yet
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 1
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg not downloaded yet
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dd650>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a7bdb82b14ca078495a6ec2184265ca8.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:56:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IHDR' 16 13
2026-04-27 07:56:59 [PIL.PngImagePlugin] DEBUG: STREAM b'pHYs' 41 9
2026-04-27 07:56:59 [PIL.PngImagePlugin] DEBUG: STREAM b'IDAT' 62 8192
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64860d0>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_3.png HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_f3832417b95c31ae554cbfbb93099c6d.png saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791
2026-04-27 07:56:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e479ac3-5bf1-583d-9ed4-7bd85f793791, skipping ID generation
2026-04-27 07:56:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with scrape type 1
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e479ac3-5bf1-583d-9ed4-7bd85f793791 sending to next pipeline
2026-04-27 07:56:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e479ac3-5bf1-583d-9ed4-7bd85f793791, identifier: LG98930
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5882d90>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_233eaabe00cb6925f93f4ab9709587d1.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead645e7d0>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:56:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_68992607bc996335b0190988c61663ef.jpg saved to cache
2026-04-27 07:56:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead642e950>
2026-04-27 07:56:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_d555028f77aeedfa2e9f2216923ace64.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_016fa817441b26fca4838a4026ce5e61.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d928bd9578a1a03add25b98b2579ca95.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_47cdfefdfa7f1f19d48fe299ecef92ea.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_e62e65fffe4e30e7c1b72e1a9c27bfa2.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with identifier: LG98930
2026-04-27 07:57:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with identifier: LG98930
2026-04-27 07:57:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e479ac3-5bf1-583d-9ed4-7bd85f793791 with identifier: LG98930 to the API
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_f3832417b95c31ae554cbfbb93099c6d.png>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Roma',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:22:38Z',
'fuel_type': 'diesel',
'id': '4e479ac3-5bf1-583d-9ed4-7bd85f793791',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LG98930',
'listing': 'auction',
'location': 'IT, Roma RM',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Ford',
'model': 'C-Max',
'odometer': 200278,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cc344ba55311e021bcd9fe607ac096d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_5b314b33581f6627d986e1e3ba7ae025.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_3cb20b8afc8ea20b39d476b7f1ecb2e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_3.png',
'Extension': 'png',
'FileSizeInBytes': 305813,
'Height': 346,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_f3832417b95c31ae554cbfbb93099c6d.png',
'Width': 411},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e479ac3-5bf1-583d-9ed4-7bd85f793791/4e479ac3-5bf1-583d-9ed4-7bd85f793791_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/bf/62bf991bdcf716e43709e04f4a0ddb7d/pa/LG98930_e073584cee5ceff2a0cab18a57c16702.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2011-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2011}
2026-04-27 07:57:00 [auto1.it] INFO: Saving data for LG98930: {'created_time': 1777276620.553362, 'last_price_update_time': 1777276620.553373, 'has_photos': True, 'auction_closing_time': 1777389758.0}
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b9c1eb31556bbbad5993ad75912ba59e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_ab70d21bed6c59b4291a298abb17f1e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_cb16d489ea7969b98c7ff38def6da19e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_7fe9bf54b0854bb699cafdbddfefb573.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_a8abf693f092d51271b434c9734a7d08.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_2318fa89f34497b9fc7c86a109ebe57e.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg not downloaded yet
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5887ad0>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_325513026efd0c0ee46e059fc42d7531.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_eb4e9f86c0e455efdef3264acc6f262d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b3ed930a0a4798222e48cf01ada12bd6.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_b23034d2a5c51a5afd84af75b31d32f1.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_d25005aebec637f906c192234161ebc5.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_215e62a24c890366321b5dafcc5b370e.jpg not downloaded yet
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5820450>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_a316a9bed73652627e5f310f5d347e92.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c0490>
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_046c88cfe42fbffa49f505024122b18a.jpg saved to cache
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_c49c27646c2153511804e190f92395e3.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_bad0f2c0a5a83e94658bc48127a5cbdd.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-04-27 07:57:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54dd442c-05bf-5106-897c-c3f9e064371c with scrape type 1
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_5d291bc13402900d707dec09f32cbd35.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_c6ad0c248a2271de0eeefd2f8ffb27f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a034843d29537b69261899aff6eba98e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_ef810712ebd69c8265cd04e482b2e8dc.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg not downloaded yet
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_423bea972b7264a094fcb67886138294.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_af457bba7d21823ef086e481ed207812.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_034b696cff22389daf657667cdbcf1f2.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_21b33c421dc5d82942f7f10ff720240d.jpg not downloaded yet
2026-04-27 07:57:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_1454607cde0681876052497cda8e8f3b.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_effec89648a4c4fa0edae3b85f77f009.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3477e1760abd1af8c64548a69631a325.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_059891f0368cb4aa944b129a75c61648.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_cb2fa5a727e7ca39cc1f2a8a5af2154c.jpg not downloaded yet
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_318af37c61a9a6a402ab959b62516a88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_2f65b2063b15f40ecaee979855f94853.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_12e092016e378268bbba61a2ce5c9b20.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38c236312f19d296772df2063d69723f.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg not downloaded yet
2026-04-27 07:57:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_3b2e456a56575235aed1547b3347891a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_960dd98b9d10fa553d0f3184d0e5e2c3.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_a3bb66af145784ce78b1d1401364c5b4.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_2263f7054e898b717a116e031d82fd53.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_410266fb555706d4d6f56aa0f237affc.jpg not downloaded yet
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_19c470b613a6d8c1b13b429f368b2838.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_b307167ec3fe792ec193b1f72a5cafad.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg not downloaded yet
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bc750>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b9c1eb31556bbbad5993ad75912ba59e.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594e350>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_ab70d21bed6c59b4291a298abb17f1e3.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b3210>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_cb16d489ea7969b98c7ff38def6da19e.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64adf10>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_7fe9bf54b0854bb699cafdbddfefb573.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fb990>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_a8abf693f092d51271b434c9734a7d08.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d390>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_eb4e9f86c0e455efdef3264acc6f262d.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5327450>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_c6ad0c248a2271de0eeefd2f8ffb27f4.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b0850>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a034843d29537b69261899aff6eba98e.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5326a10>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_423bea972b7264a094fcb67886138294.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815590>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_af457bba7d21823ef086e481ed207812.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_79713a6a0e88f9af23b9b72724199f75.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_40adb7718ef3d7222845b5704a2bc355.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_41bf03e1aaafca9cc9a42debd69b0fda.jpg not downloaded yet
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_8f84213ef103e0ec2b0496ad8fb872dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_19c9a0eb39dcf22b71377f32b10f19a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_e62e65fffe4e30e7c1b72e1a9c27bfa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_bcf16e2642b750e476032a6de17c86ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_6a6fa8e02ac28f0b5e76630604061517.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg not downloaded yet
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5768c10>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_318af37c61a9a6a402ab959b62516a88.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64671d0>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_2f65b2063b15f40ecaee979855f94853.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6466710>
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_12e092016e378268bbba61a2ce5c9b20.jpg saved to cache
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_44aaaf5d63289cc8c8688ba24062d3c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_2de9b3f7c049bb024989dbba2324d099.jpg not downloaded yet
2026-04-27 07:57:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_b681062a3bd5e6ed89f52202d4f676d4.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_aaa638682fcac5d621a288cafcfd4ad2.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT21466> (referer: https://www.auto1.com/v1/car-details-view/JT21466/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6466310>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_3b2e456a56575235aed1547b3347891a.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59be550>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_19c470b613a6d8c1b13b429f368b2838.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_5d291bc13402900d707dec09f32cbd35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_bad0f2c0a5a83e94658bc48127a5cbdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38b55f2afcad243ef0da0cc683b2bad3.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38c236312f19d296772df2063d69723f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_c49c27646c2153511804e190f92395e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_b0e830c33247c1e36fd5e74f89f52d78.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_04c98f005bc6a022cec3cb0aeaa7ee91.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_425e58f28f8f8be64b23bc6b4e41e421.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659a610>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6f90>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_8f84213ef103e0ec2b0496ad8fb872dc.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c8650>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_19c9a0eb39dcf22b71377f32b10f19a7.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547d950>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_e62e65fffe4e30e7c1b72e1a9c27bfa2.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5885ad0>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_bcf16e2642b750e476032a6de17c86ae.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_ef810712ebd69c8265cd04e482b2e8dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_72f0476bcd2ae77f1f0b162756524dce.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d8e10>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_44aaaf5d63289cc8c8688ba24062d3c8.jpg saved to cache
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with identifier: JT21466
2026-04-27 07:57:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with scrape type 1
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_1a962952dc870e89d73c924e637955df.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_b307167ec3fe792ec193b1f72a5cafad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_988791ed00f7030e17614fb77d6bc1d1.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_4e3e8b0d32d7a83cb53033c7b77fe8c8.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8059c2b99ee824d6f31b7dd13b7b7b21.jpg not downloaded yet
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_410266fb555706d4d6f56aa0f237affc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_c057c9a77a0c6e83ce4d089d84cc5223.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg not downloaded yet
2026-04-27 07:57:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_a96ea75d05bbbfb7e5e64fc779d25b41.jpg not downloaded yet
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d6010>
2026-04-27 07:57:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_5d291bc13402900d707dec09f32cbd35.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5511e50>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_bad0f2c0a5a83e94658bc48127a5cbdd.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f60d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38c236312f19d296772df2063d69723f.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55134d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_c49c27646c2153511804e190f92395e3.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555a850>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_bd6217c4cb0b9c3679ab565ea1264a83.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_1a2e65179b27b48b1ac389ec358ef263.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_c99cd598df6f81e864f6f95da9965953.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_2263f7054e898b717a116e031d82fd53.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_6a6fa8e02ac28f0b5e76630604061517.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_41bf03e1aaafca9cc9a42debd69b0fda.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_e8b04a93ae7b4bbb482ffff552748b93.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_845cad2005ced56adb77d837d1643e0f.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_a3bb66af145784ce78b1d1401364c5b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3e2652c50ff399752638daf1bffdf3df.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c49a5a4d6a41c6c8e72b2f8d888dda4a.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_398ebb88131bf438cf5059d6ffd8af33.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PV47203> (referer: https://www.auto1.com/v1/car-details-view/PV47203/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56267d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_ef810712ebd69c8265cd04e482b2e8dc.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3290>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59685d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_b307167ec3fe792ec193b1f72a5cafad.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b02d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_410266fb555706d4d6f56aa0f237affc.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a909d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b46da1b2ec13d4085bd2029d92f89a0c.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_40adb7718ef3d7222845b5704a2bc355.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_b681062a3bd5e6ed89f52202d4f676d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_f7f4b1cac3e219753f150b78430b2fc6.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c3eb65ec6793c1abc1cdf03315f52cd4.jpg not downloaded yet
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8aec52459a6236a841f5d30fabef3c75.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_aaa638682fcac5d621a288cafcfd4ad2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_1a962952dc870e89d73c924e637955df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_ea1cc2b3bd37e4f98a6610135d685313.jpg not downloaded yet
2026-04-27 07:57:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT05418> (referer: https://www.auto1.com/v1/car-details-view/LT05418/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550ea10>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_2263f7054e898b717a116e031d82fd53.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c1710>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_6a6fa8e02ac28f0b5e76630604061517.jpg saved to cache
2026-04-27 07:57:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65938d0>
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_41bf03e1aaafca9cc9a42debd69b0fda.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e0390>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_a3bb66af145784ce78b1d1401364c5b4.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6337cd0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38b55f2afcad243ef0da0cc683b2bad3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_5b04ad89934c2282b7e2e27facef606f.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_2de9b3f7c049bb024989dbba2324d099.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6379690>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_40adb7718ef3d7222845b5704a2bc355.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d1b10>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_b681062a3bd5e6ed89f52202d4f676d4.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a70ad0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_aaa638682fcac5d621a288cafcfd4ad2.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3fd0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_1a962952dc870e89d73c924e637955df.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 420fa099-4bdb-5509-9a9a-f27eb9145762 with identifier: LT05418
2026-04-27 07:57:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 420fa099-4bdb-5509-9a9a-f27eb9145762 with scrape type 1
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_975b209ce1655cef49b5e513517f7051.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b7154ac97f5380c5d5733e60bd71f297.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_72f0476bcd2ae77f1f0b162756524dce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_1a2e65179b27b48b1ac389ec358ef263.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_292f3b0206a7bd7fce37c3369b6f2a33.jpg not downloaded yet
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_c99cd598df6f81e864f6f95da9965953.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_bd6217c4cb0b9c3679ab565ea1264a83.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_2fe6525d9142c28e5e191a58e2407380.jpg not downloaded yet
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg not downloaded yet
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665e10>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38b55f2afcad243ef0da0cc683b2bad3.jpg saved to cache
2026-04-27 07:57:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a526d0>
2026-04-27 07:57:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3e50>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659b690>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_2de9b3f7c049bb024989dbba2324d099.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_a96ea75d05bbbfb7e5e64fc779d25b41.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_f881433437ec7fc76621692f6d3dcdf1.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_845cad2005ced56adb77d837d1643e0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b46da1b2ec13d4085bd2029d92f89a0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_cc81137f577904fa9ec331c2d2293f38.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_7ffbacc0af1fc439736662defb60c54b.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_73627041d90e9c7865cb64ca89af5349.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c49a5a4d6a41c6c8e72b2f8d888dda4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_1a0df6b2246f7547af07451c10a49bb7.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c3bd0>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_72f0476bcd2ae77f1f0b162756524dce.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553f090>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_1a2e65179b27b48b1ac389ec358ef263.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a73f90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_c99cd598df6f81e864f6f95da9965953.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562ab10>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_bd6217c4cb0b9c3679ab565ea1264a83.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg not downloaded yet
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_ea1cc2b3bd37e4f98a6610135d685313.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c3eb65ec6793c1abc1cdf03315f52cd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_ba3d00195d165f727bb21059ccd6ce1e.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f5f90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_a96ea75d05bbbfb7e5e64fc779d25b41.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a1490>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_845cad2005ced56adb77d837d1643e0f.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56def10>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b46da1b2ec13d4085bd2029d92f89a0c.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8aec52459a6236a841f5d30fabef3c75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3e2652c50ff399752638daf1bffdf3df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_398ebb88131bf438cf5059d6ffd8af33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_f7f4b1cac3e219753f150b78430b2fc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg not downloaded yet
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b49256c647825f933287c1453d73b1e8.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552b5d0>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56dcd90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c49a5a4d6a41c6c8e72b2f8d888dda4a.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg not downloaded yet
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6465a90>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_ea1cc2b3bd37e4f98a6610135d685313.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6385210>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c3eb65ec6793c1abc1cdf03315f52cd4.jpg saved to cache
2026-04-27 07:57:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65e3590>
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_2fe6525d9142c28e5e191a58e2407380.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_6a6c6e14d17b0723b1e7b47bd38bacad.jpg not downloaded yet
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b7154ac97f5380c5d5733e60bd71f297.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_975b209ce1655cef49b5e513517f7051.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_292f3b0206a7bd7fce37c3369b6f2a33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg not downloaded yet
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead574c950>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8aec52459a6236a841f5d30fabef3c75.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f84d0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3e2652c50ff399752638daf1bffdf3df.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5818750>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_398ebb88131bf438cf5059d6ffd8af33.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f80d0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_f7f4b1cac3e219753f150b78430b2fc6.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_f881433437ec7fc76621692f6d3dcdf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_14b24c8d9bd3fbe5ea4e106f522267b2.jpg not downloaded yet
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b32332e20d8957e635d95f0aa6f7f2d7.jpg not downloaded yet
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5411650>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_2fe6525d9142c28e5e191a58e2407380.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64667d0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839a0d0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b7154ac97f5380c5d5733e60bd71f297.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5945e90>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_975b209ce1655cef49b5e513517f7051.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f9b10>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_292f3b0206a7bd7fce37c3369b6f2a33.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58da890>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_7ffbacc0af1fc439736662defb60c54b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_cc81137f577904fa9ec331c2d2293f38.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_5b04ad89934c2282b7e2e27facef606f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_73627041d90e9c7865cb64ca89af5349.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_1a0df6b2246f7547af07451c10a49bb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5457f50>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58fb290>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_f881433437ec7fc76621692f6d3dcdf1.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29e90>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_7ffbacc0af1fc439736662defb60c54b.jpg saved to cache
2026-04-27 07:57:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5334bd0>
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_cc81137f577904fa9ec331c2d2293f38.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead641c250>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5587710>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_5b04ad89934c2282b7e2e27facef606f.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b4d0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5663c50>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_73627041d90e9c7865cb64ca89af5349.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92
2026-04-27 07:57:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92, skipping ID generation
2026-04-27 07:57:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with scrape type 1
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 sending to next pipeline
2026-04-27 07:57:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92, identifier: JT21466
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56946d0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_1a0df6b2246f7547af07451c10a49bb7.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b4dd0>
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg saved to cache
2026-04-27 07:57:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_6a6c6e14d17b0723b1e7b47bd38bacad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with identifier: JT21466
2026-04-27 07:57:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with identifier: JT21466
2026-04-27 07:57:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6ff5b506-7829-55b2-8f3b-1fbfcaba5c92 with identifier: JT21466 to the API
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_73627041d90e9c7865cb64ca89af5349.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:28:16Z',
'fuel_type': 'diesel',
'id': '6ff5b506-7829-55b2-8f3b-1fbfcaba5c92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT21466',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 220110,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_1a962952dc870e89d73c924e637955df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_a96ea75d05bbbfb7e5e64fc779d25b41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_845cad2005ced56adb77d837d1643e0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b46da1b2ec13d4085bd2029d92f89a0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_ea1cc2b3bd37e4f98a6610135d685313.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59061,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_5b04ad89934c2282b7e2e27facef606f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_b7154ac97f5380c5d5733e60bd71f297.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_2fe6525d9142c28e5e191a58e2407380.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_cc81137f577904fa9ec331c2d2293f38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6ff5b506-7829-55b2-8f3b-1fbfcaba5c92/6ff5b506-7829-55b2-8f3b-1fbfcaba5c92_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9f/64/9f64b901d469efaa8978d1dd9722f52a/pa/JT21466_73627041d90e9c7865cb64ca89af5349.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2013-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2013}
2026-04-27 07:57:08 [auto1.it] INFO: Saving data for JT21466: {'created_time': 1777276628.121665, 'last_price_update_time': 1777276628.121681, 'has_photos': True, 'auction_closing_time': 1777390096.0}
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_ba3d00195d165f727bb21059ccd6ce1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b49256c647825f933287c1453d73b1e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_e8b04a93ae7b4bbb482ffff552748b93.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b32332e20d8957e635d95f0aa6f7f2d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_c057c9a77a0c6e83ce4d089d84cc5223.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_14b24c8d9bd3fbe5ea4e106f522267b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580fc50>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3cd0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53977d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_6a6c6e14d17b0723b1e7b47bd38bacad.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0ad0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_ba3d00195d165f727bb21059ccd6ce1e.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e0ad0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b49256c647825f933287c1453d73b1e8.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f92d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_e8b04a93ae7b4bbb482ffff552748b93.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b60d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b32332e20d8957e635d95f0aa6f7f2d7.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56b03d0>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5514310>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_c057c9a77a0c6e83ce4d089d84cc5223.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3210>
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_14b24c8d9bd3fbe5ea4e106f522267b2.jpg saved to cache
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 420fa099-4bdb-5509-9a9a-f27eb9145762
2026-04-27 07:57:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 420fa099-4bdb-5509-9a9a-f27eb9145762, skipping ID generation
2026-04-27 07:57:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 420fa099-4bdb-5509-9a9a-f27eb9145762 with scrape type 1
2026-04-27 07:57:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 420fa099-4bdb-5509-9a9a-f27eb9145762 sending to next pipeline
2026-04-27 07:57:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 420fa099-4bdb-5509-9a9a-f27eb9145762, identifier: LT05418
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_04c98f005bc6a022cec3cb0aeaa7ee91.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_79713a6a0e88f9af23b9b72724199f75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 420fa099-4bdb-5509-9a9a-f27eb9145762 with identifier: LT05418
2026-04-27 07:57:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 420fa099-4bdb-5509-9a9a-f27eb9145762 with identifier: LT05418
2026-04-27 07:57:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 420fa099-4bdb-5509-9a9a-f27eb9145762 with identifier: LT05418 to the API
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_14b24c8d9bd3fbe5ea4e106f522267b2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Capannori',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:35:42Z',
'fuel_type': 'diesel',
'id': '420fa099-4bdb-5509-9a9a-f27eb9145762',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT05418',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Mercedes-Benz',
'model': 'C-Klasse',
'odometer': 48700,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82325,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_975b209ce1655cef49b5e513517f7051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88512,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_292f3b0206a7bd7fce37c3369b6f2a33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77503,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_f881433437ec7fc76621692f6d3dcdf1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61369,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_7ffbacc0af1fc439736662defb60c54b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80935,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_1a0df6b2246f7547af07451c10a49bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_ba3d00195d165f727bb21059ccd6ce1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b49256c647825f933287c1453d73b1e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_6a6c6e14d17b0723b1e7b47bd38bacad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_14b24c8d9bd3fbe5ea4e106f522267b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_420fa099-4bdb-5509-9a9a-f27eb9145762/420fa099-4bdb-5509-9a9a-f27eb9145762_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga9/e7/a9e78db77c7807775f87af7edc7d19ea/pa/LT05418_b32332e20d8957e635d95f0aa6f7f2d7.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2018-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz C-Klasse C 220 d 4Matic Sport',
'transmission': 'automatic',
'trim': '4Matic Sport',
'year': 2018}
2026-04-27 07:57:09 [auto1.it] INFO: Saving data for LT05418: {'created_time': 1777276629.146178, 'last_price_update_time': 1777276629.146194, 'has_photos': True, 'auction_closing_time': 1777390542.0}
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_4e3e8b0d32d7a83cb53033c7b77fe8c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8059c2b99ee824d6f31b7dd13b7b7b21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_988791ed00f7030e17614fb77d6bc1d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_b0e830c33247c1e36fd5e74f89f52d78.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_425e58f28f8f8be64b23bc6b4e41e421.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b8750>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_04c98f005bc6a022cec3cb0aeaa7ee91.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6328e90>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_79713a6a0e88f9af23b9b72724199f75.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d9b10>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_4e3e8b0d32d7a83cb53033c7b77fe8c8.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_cb2fa5a727e7ca39cc1f2a8a5af2154c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56786d0>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3
2026-04-27 07:57:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3, skipping ID generation
2026-04-27 07:57:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with scrape type 1
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 sending to next pipeline
2026-04-27 07:57:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3, identifier: PV47203
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632a1d0>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8059c2b99ee824d6f31b7dd13b7b7b21.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54bb290>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_988791ed00f7030e17614fb77d6bc1d1.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5327590>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_b0e830c33247c1e36fd5e74f89f52d78.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fa910>
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_425e58f28f8f8be64b23bc6b4e41e421.jpg saved to cache
2026-04-27 07:57:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-04-27 07:57:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203
2026-04-27 07:57:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3 with identifier: PV47203 to the API
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Milano',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:09:00Z',
'fuel_type': 'petrol',
'id': '1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PV47203',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Volkswagen',
'model': 'Taigo',
'odometer': 14575,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_83f1c1f0af61cbfbd5da543b587fc5ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_a8a16a0869077d684990264d3aae48b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_085309c910f98069dd1ec7ccd3c86aa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62782,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_12330d594426a0107ae0b516d5b434e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75895,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_e5ae8f9ffb2c789f60ffcba27dadaf40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92719,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_dc8b573593518c594a8e1716e8857a11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_720804120963bbd1c7e5023b3d64babd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_38344e1f17aae0ebdd9f4a30bcf8e463.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76432,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_91790f3254ff01747d01184dfb8273d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3/1ec66dd0-4a6d-5d78-87d4-79b7067bbeb3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge6/b5/e6b54352017b7f12d635372a3b22d354/pa/PV47203_4a75af54da2d5af8459b0c0e8cdec54d.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2023-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Taigo 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-04-27 07:57:10 [auto1.it] INFO: Saving data for PV47203: {'created_time': 1777276630.052828, 'last_price_update_time': 1777276630.052842, 'has_photos': True, 'auction_closing_time': 1777388940.0}
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_21b33c421dc5d82942f7f10ff720240d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_034b696cff22389daf657667cdbcf1f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_1454607cde0681876052497cda8e8f3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_960dd98b9d10fa553d0f3184d0e5e2c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_effec89648a4c4fa0edae3b85f77f009.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_059891f0368cb4aa944b129a75c61648.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3477e1760abd1af8c64548a69631a325.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_215e62a24c890366321b5dafcc5b370e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549bd90>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_cb2fa5a727e7ca39cc1f2a8a5af2154c.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54dd442c-05bf-5106-897c-c3f9e064371c
2026-04-27 07:57:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54dd442c-05bf-5106-897c-c3f9e064371c, skipping ID generation
2026-04-27 07:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54dd442c-05bf-5106-897c-c3f9e064371c with scrape type 1
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54dd442c-05bf-5106-897c-c3f9e064371c sending to next pipeline
2026-04-27 07:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 54dd442c-05bf-5106-897c-c3f9e064371c, identifier: AF81201
2026-04-27 07:57:10 [scrapy.extensions.logstats] INFO: Crawled 300 pages (at 76 pages/min), scraped 101 items (at 42 items/min)
2026-04-27 07:57:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 07:57:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-04-27 07:57:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201
2026-04-27 07:57:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 54dd442c-05bf-5106-897c-c3f9e064371c with identifier: AF81201 to the API
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_cb2fa5a727e7ca39cc1f2a8a5af2154c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'city': 'Milazzo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:44:28Z',
'fuel_type': 'diesel',
'id': '54dd442c-05bf-5106-897c-c3f9e064371c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AF81201',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Land Rover',
'model': 'Freelander',
'odometer': 272333,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_5d291bc13402900d707dec09f32cbd35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_cb2fa5a727e7ca39cc1f2a8a5af2154c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_410266fb555706d4d6f56aa0f237affc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68201,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_41bf03e1aaafca9cc9a42debd69b0fda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_aaa638682fcac5d621a288cafcfd4ad2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_425e58f28f8f8be64b23bc6b4e41e421.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8059c2b99ee824d6f31b7dd13b7b7b21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_c99cd598df6f81e864f6f95da9965953.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_398ebb88131bf438cf5059d6ffd8af33.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_54dd442c-05bf-5106-897c-c3f9e064371c/54dd442c-05bf-5106-897c-c3f9e064371c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/80/6b8087c2ee471dd1113eb272bf295744/pa/AF81201_8aec52459a6236a841f5d30fabef3c75.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2014-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Freelander 2.2 Td4 SE',
'transmission': 'manual',
'trim': 'SE',
'year': 2014}
2026-04-27 07:57:10 [auto1.it] INFO: Saving data for AF81201: {'created_time': 1777276630.589245, 'last_price_update_time': 1777276630.589256, 'has_photos': True, 'auction_closing_time': 1777391068.0}
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_d25005aebec637f906c192234161ebc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_47cdfefdfa7f1f19d48fe299ecef92ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_b23034d2a5c51a5afd84af75b31d32f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b3ed930a0a4798222e48cf01ada12bd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d928bd9578a1a03add25b98b2579ca95.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_016fa817441b26fca4838a4026ce5e61.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_2318fa89f34497b9fc7c86a109ebe57e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550f590>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_21b33c421dc5d82942f7f10ff720240d.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5768590>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_034b696cff22389daf657667cdbcf1f2.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549bc90>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_1454607cde0681876052497cda8e8f3b.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b290>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_960dd98b9d10fa553d0f3184d0e5e2c3.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cf6d0>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_effec89648a4c4fa0edae3b85f77f009.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f5890>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_059891f0368cb4aa944b129a75c61648.jpg saved to cache
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd
2026-04-27 07:57:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd, skipping ID generation
2026-04-27 07:57:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with scrape type 1
2026-04-27 07:57:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b2ea67f-529f-589e-9934-ca76b4f4b9dd sending to next pipeline
2026-04-27 07:57:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd, identifier: KC73163
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5338410>
2026-04-27 07:57:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3477e1760abd1af8c64548a69631a325.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec
2026-04-27 07:57:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec, skipping ID generation
2026-04-27 07:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with scrape type 1
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec sending to next pipeline
2026-04-27 07:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec, identifier: VS63057
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566d2d0>
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_215e62a24c890366321b5dafcc5b370e.jpg saved to cache
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f632eafe-7fe9-5ce6-a445-cb029e3ed436
2026-04-27 07:57:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f632eafe-7fe9-5ce6-a445-cb029e3ed436, skipping ID generation
2026-04-27 07:57:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f632eafe-7fe9-5ce6-a445-cb029e3ed436 with scrape type 1
2026-04-27 07:57:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f632eafe-7fe9-5ce6-a445-cb029e3ed436 sending to next pipeline
2026-04-27 07:57:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f632eafe-7fe9-5ce6-a445-cb029e3ed436, identifier: XV36287
2026-04-27 07:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-04-27 07:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163
2026-04-27 07:57:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0b2ea67f-529f-589e-9934-ca76b4f4b9dd with identifier: KC73163 to the API
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_059891f0368cb4aa944b129a75c61648.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:05:28Z',
'fuel_type': 'diesel',
'id': '0b2ea67f-529f-589e-9934-ca76b4f4b9dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC73163',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Alfa Romeo',
'model': 'Giulietta',
'odometer': 181099,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68734,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_bad0f2c0a5a83e94658bc48127a5cbdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_059891f0368cb4aa944b129a75c61648.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_2263f7054e898b717a116e031d82fd53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_40adb7718ef3d7222845b5704a2bc355.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_b681062a3bd5e6ed89f52202d4f676d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_04c98f005bc6a022cec3cb0aeaa7ee91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_4e3e8b0d32d7a83cb53033c7b77fe8c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60729,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_1a2e65179b27b48b1ac389ec358ef263.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c49a5a4d6a41c6c8e72b2f8d888dda4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0b2ea67f-529f-589e-9934-ca76b4f4b9dd/0b2ea67f-529f-589e-9934-ca76b4f4b9dd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/ec/76ecba99c741f5ec1fa68f840d344a47/pa/KC73163_c3eb65ec6793c1abc1cdf03315f52cd4.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2013-07-09',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulietta 2.0 JTDM Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2013}
2026-04-27 07:57:11 [auto1.it] INFO: Saving data for KC73163: {'created_time': 1777276631.69098, 'last_price_update_time': 1777276631.690991, 'has_photos': True, 'auction_closing_time': 1777388728.0}
2026-04-27 07:57:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-04-27 07:57:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057
2026-04-27 07:57:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec with identifier: VS63057 to the API
2026-04-27 07:57:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3477e1760abd1af8c64548a69631a325.jpg>
{'auction_title': '',
'c_o_2_emission_value': 4,
'category': None,
'city': 'Padova',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:05:06Z',
'fuel_type': 'diesel',
'id': 'bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VS63057',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Fiat',
'model': '500L',
'odometer': 174647,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_c49c27646c2153511804e190f92395e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83390,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3477e1760abd1af8c64548a69631a325.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86308,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_a3bb66af145784ce78b1d1401364c5b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_79713a6a0e88f9af23b9b72724199f75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_2de9b3f7c049bb024989dbba2324d099.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_b0e830c33247c1e36fd5e74f89f52d78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_988791ed00f7030e17614fb77d6bc1d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_bd6217c4cb0b9c3679ab565ea1264a83.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_3e2652c50ff399752638daf1bffdf3df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec/bbfd0d62-93be-5cf0-baa1-2de2dc9c80ec_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75903,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imged/d9/edd96b2eee5c7a183a5b45702e7f972b/pa/VS63057_f7f4b1cac3e219753f150b78430b2fc6.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2017-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2017}
2026-04-27 07:57:12 [auto1.it] INFO: Saving data for VS63057: {'created_time': 1777276632.150027, 'last_price_update_time': 1777276632.150038, 'has_photos': True, 'auction_closing_time': 1777388706.0}
2026-04-27 07:57:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f632eafe-7fe9-5ce6-a445-cb029e3ed436 with identifier: XV36287
2026-04-27 07:57:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f632eafe-7fe9-5ce6-a445-cb029e3ed436 with identifier: XV36287
2026-04-27 07:57:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f632eafe-7fe9-5ce6-a445-cb029e3ed436 with identifier: XV36287 to the API
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_215e62a24c890366321b5dafcc5b370e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:38:03Z',
'fuel_type': 'diesel',
'id': 'f632eafe-7fe9-5ce6-a445-cb029e3ed436',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XV36287',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 184282,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a7bdb82b14ca078495a6ec2184265ca8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_325513026efd0c0ee46e059fc42d7531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_a034843d29537b69261899aff6eba98e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93960,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_eb4e9f86c0e455efdef3264acc6f262d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_12e092016e378268bbba61a2ce5c9b20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98079,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_44aaaf5d63289cc8c8688ba24062d3c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_e62e65fffe4e30e7c1b72e1a9c27bfa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_215e62a24c890366321b5dafcc5b370e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_effec89648a4c4fa0edae3b85f77f009.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f632eafe-7fe9-5ce6-a445-cb029e3ed436/f632eafe-7fe9-5ce6-a445-cb029e3ed436_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/4d/684de1db8d5f5f5bd39794966ffda86e/pa/XV36287_960dd98b9d10fa553d0f3184d0e5e2c3.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2016-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TDI Design',
'transmission': 'automatic',
'trim': 'Design',
'year': 2016}
2026-04-27 07:57:12 [auto1.it] INFO: Saving data for XV36287: {'created_time': 1777276632.52044, 'last_price_update_time': 1777276632.520453, 'has_photos': True, 'auction_closing_time': 1777390683.0}
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_70d28570edbfef364b08457fedcde08a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_94c02cef0e2eced1ab5ca7b66fc6e62f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_d3f8c7c632fe4a92bb600493ee097852.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5b90>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_d25005aebec637f906c192234161ebc5.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63a8710>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_47cdfefdfa7f1f19d48fe299ecef92ea.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aaa110>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_b23034d2a5c51a5afd84af75b31d32f1.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c3590>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b3ed930a0a4798222e48cf01ada12bd6.jpg saved to cache
2026-04-27 07:57:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57091d0>
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d928bd9578a1a03add25b98b2579ca95.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d8e10>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_016fa817441b26fca4838a4026ce5e61.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6356250>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_2318fa89f34497b9fc7c86a109ebe57e.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d
2026-04-27 07:57:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1860f3b3-5adb-5ab6-8cba-928e37752d6d, skipping ID generation
2026-04-27 07:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d with scrape type 1
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1860f3b3-5adb-5ab6-8cba-928e37752d6d sending to next pipeline
2026-04-27 07:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1860f3b3-5adb-5ab6-8cba-928e37752d6d, identifier: YP09889
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4eb7810>
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg saved to cache
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d
2026-04-27 07:57:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3652c92f-d6ed-5635-a482-c31d8f9fc39d, skipping ID generation
2026-04-27 07:57:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d with scrape type 1
2026-04-27 07:57:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3652c92f-d6ed-5635-a482-c31d8f9fc39d sending to next pipeline
2026-04-27 07:57:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3652c92f-d6ed-5635-a482-c31d8f9fc39d, identifier: PK33610
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_f71599ff987b39e9f81be411c7bdf956.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_1d3f2918a0d862aff5a73301ca924d99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d0440051b479d2ac263e48a663238556.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_28d5f09b3cf1a00d9ab5b160e53d1166.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_5879ad653c61374245415aef0e8a60fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1860f3b3-5adb-5ab6-8cba-928e37752d6d with identifier: YP09889
2026-04-27 07:57:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1860f3b3-5adb-5ab6-8cba-928e37752d6d with identifier: YP09889
2026-04-27 07:57:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1860f3b3-5adb-5ab6-8cba-928e37752d6d with identifier: YP09889 to the API
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_2318fa89f34497b9fc7c86a109ebe57e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:08:14Z',
'fuel_type': 'diesel',
'id': '1860f3b3-5adb-5ab6-8cba-928e37752d6d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP09889',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 111697,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_19c470b613a6d8c1b13b429f368b2838.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_2318fa89f34497b9fc7c86a109ebe57e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_ef810712ebd69c8265cd04e482b2e8dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38c236312f19d296772df2063d69723f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_b307167ec3fe792ec193b1f72a5cafad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_6a6fa8e02ac28f0b5e76630604061517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_38b55f2afcad243ef0da0cc683b2bad3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_72f0476bcd2ae77f1f0b162756524dce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_c057c9a77a0c6e83ce4d089d84cc5223.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1860f3b3-5adb-5ab6-8cba-928e37752d6d/1860f3b3-5adb-5ab6-8cba-928e37752d6d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/42/3142a112ae81bc276f5ea2bb8c52cbd3/pa/YP09889_e8b04a93ae7b4bbb482ffff552748b93.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2018-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Td4 Pure',
'transmission': 'automatic',
'trim': 'Pure',
'year': 2018}
2026-04-27 07:57:13 [auto1.it] INFO: Saving data for YP09889: {'created_time': 1777276633.862212, 'last_price_update_time': 1777276633.862222, 'has_photos': True, 'auction_closing_time': 1777388894.0}
2026-04-27 07:57:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:57:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3652c92f-d6ed-5635-a482-c31d8f9fc39d with identifier: PK33610 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Capua',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:56:40Z',
'fuel_type': 'petrol',
'id': '3652c92f-d6ed-5635-a482-c31d8f9fc39d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK33610',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Peugeot',
'model': '208',
'odometer': 26446,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_69833282e5d36efb960808b5964e8ebe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3c48f6c3297c30a11e10fd2f09bb8499.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_0bd7310beaf2ff95d339a4619249b827.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_a21e10280aabaaba4484f3a798107a6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_5a013466b2cc6e10b9d98dce6f70673e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_233d28178b1ec672dd965ad339c6611d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c4c1c07fcef296d9242604651dcf5805.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_3103932431cc3ee03c0374d6d58d1ff0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_7eeedb87ac33c0a890cdb7ef8551dc7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3652c92f-d6ed-5635-a482-c31d8f9fc39d/3652c92f-d6ed-5635-a482-c31d8f9fc39d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/dd/71ddf47d2f6b29b49fdb4501aab760e2/pa/PK33610_c94c834bd52ca25bfcb9801113b2bae9.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2021-01-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active Pack',
'transmission': 'manual',
'trim': 'Active Pack',
'year': 2021}
2026-04-27 07:57:14 [auto1.it] INFO: Saving data for PK33610: {'created_time': 1777276634.415981, 'last_price_update_time': 1777276634.415994, 'has_photos': True, 'auction_closing_time': 1777391800.0}
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ce350>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_70d28570edbfef364b08457fedcde08a.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af8a25cc-3da0-5730-9474-582023b076cb
2026-04-27 07:57:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8a25cc-3da0-5730-9474-582023b076cb, skipping ID generation
2026-04-27 07:57:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af8a25cc-3da0-5730-9474-582023b076cb with scrape type 1
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af8a25cc-3da0-5730-9474-582023b076cb sending to next pipeline
2026-04-27 07:57:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: af8a25cc-3da0-5730-9474-582023b076cb, identifier: UX19423
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5666fd0>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_94c02cef0e2eced1ab5ca7b66fc6e62f.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f9ed0>
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_d3f8c7c632fe4a92bb600493ee097852.jpg saved to cache
2026-04-27 07:57:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_0777da29987b5e2fd72a2f49e1026ea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_14e11bbeb509c1cef5c1ad870c882031.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_22ba3793b2b9fc3f75c23b85255c1213.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: af8a25cc-3da0-5730-9474-582023b076cb with identifier: UX19423
2026-04-27 07:57:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: af8a25cc-3da0-5730-9474-582023b076cb with identifier: UX19423
2026-04-27 07:57:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: af8a25cc-3da0-5730-9474-582023b076cb with identifier: UX19423 to the API
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_70d28570edbfef364b08457fedcde08a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:19:35Z',
'fuel_type': 'diesel',
'id': 'af8a25cc-3da0-5730-9474-582023b076cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UX19423',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Dacia',
'model': 'Duster',
'odometer': 92765,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_b71db49e205d7b9b25703dbc00aca300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_233eaabe00cb6925f93f4ab9709587d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59167,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_68992607bc996335b0190988c61663ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_70d28570edbfef364b08457fedcde08a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56946,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_ab70d21bed6c59b4291a298abb17f1e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_af457bba7d21823ef086e481ed207812.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40918,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_8f84213ef103e0ec2b0496ad8fb872dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57014,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_47cdfefdfa7f1f19d48fe299ecef92ea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53812,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_d25005aebec637f906c192234161ebc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_af8a25cc-3da0-5730-9474-582023b076cb/af8a25cc-3da0-5730-9474-582023b076cb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb6/34/b634d1c770d88e69bdc5416b6fa04a7b/pa/UX19423_1454607cde0681876052497cda8e8f3b.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2021-04-25',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.5 Blue dCi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2021}
2026-04-27 07:57:15 [auto1.it] INFO: Saving data for UX19423: {'created_time': 1777276635.048312, 'last_price_update_time': 1777276635.048325, 'has_photos': True, 'auction_closing_time': 1777389575.0}
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7e3f5f37b2f0c020c8de725aa78e3b42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f6a90>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_f71599ff987b39e9f81be411c7bdf956.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c9d90>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_1d3f2918a0d862aff5a73301ca924d99.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bcb10>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d0440051b479d2ac263e48a663238556.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92, skipping ID generation
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with scrape type 1
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 sending to next pipeline
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92, identifier: FX34637
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bcf90>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_28d5f09b3cf1a00d9ab5b160e53d1166.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f6a90>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_5879ad653c61374245415aef0e8a60fb.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_40a4848df3947bec22359dacac611246.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_8d66057615d7de2773d3c9ccd786b7f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with identifier: FX34637
2026-04-27 07:57:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with identifier: FX34637
2026-04-27 07:57:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92 with identifier: FX34637 to the API
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d0440051b479d2ac263e48a663238556.jpg>
{'auction_title': '',
'c_o_2_emission_value': 166,
'category': None,
'city': 'Capua',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-28T15:18:57Z',
'fuel_type': 'diesel',
'id': 'c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FX34637',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 260575,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_111dadf7520182b4aeef431094716a4f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103043,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_f71599ff987b39e9f81be411c7bdf956.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103097,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_046c88cfe42fbffa49f505024122b18a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d0440051b479d2ac263e48a663238556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_a8abf693f092d51271b434c9734a7d08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_2f65b2063b15f40ecaee979855f94853.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_bcf16e2642b750e476032a6de17c86ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_d928bd9578a1a03add25b98b2579ca95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_b23034d2a5c51a5afd84af75b31d32f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92/c5d45d0e-ab3a-5de0-8285-04f1fdbd5a92_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/48/2e4850a4dd5296e3bdacd97935735a99/pa/FX34637_21b33c421dc5d82942f7f10ff720240d.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2019}
2026-04-27 07:57:15 [auto1.it] INFO: Saving data for FX34637: {'created_time': 1777276635.720398, 'last_price_update_time': 1777276635.720412, 'has_photos': True, 'auction_closing_time': 1777389537.0}
2026-04-27 07:57:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54adf90>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_0777da29987b5e2fd72a2f49e1026ea3.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721f650>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_14e11bbeb509c1cef5c1ad870c882031.jpg saved to cache
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 831b0cd3-f677-56db-bb13-ebfbcc80c122
2026-04-27 07:57:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 831b0cd3-f677-56db-bb13-ebfbcc80c122, skipping ID generation
2026-04-27 07:57:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 831b0cd3-f677-56db-bb13-ebfbcc80c122 with scrape type 1
2026-04-27 07:57:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 831b0cd3-f677-56db-bb13-ebfbcc80c122 sending to next pipeline
2026-04-27 07:57:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 831b0cd3-f677-56db-bb13-ebfbcc80c122, identifier: LU21739
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548e810>
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_22ba3793b2b9fc3f75c23b85255c1213.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5ae52c6418eb6e993aa8c906dac9255f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_977019eec6b3666779715f935a8523d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739
2026-04-27 07:57:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 831b0cd3-f677-56db-bb13-ebfbcc80c122 with identifier: LU21739 to the API
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_14e11bbeb509c1cef5c1ad870c882031.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.1L',
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:59:02Z',
'fuel_type': 'petrol',
'id': '831b0cd3-f677-56db-bb13-ebfbcc80c122',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LU21739',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Citroen',
'model': 'C3',
'odometer': 169946,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78356,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_14e11bbeb509c1cef5c1ad870c882031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_28d5f09b3cf1a00d9ab5b160e53d1166.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_5879ad653c61374245415aef0e8a60fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_1d3f2918a0d862aff5a73301ca924d99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_7fe9bf54b0854bb699cafdbddfefb573.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_831b0cd3-f677-56db-bb13-ebfbcc80c122/831b0cd3-f677-56db-bb13-ebfbcc80c122_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/f3/07f3e1ba63b8156f5efa631feabda50b/pa/LU21739_318af37c61a9a6a402ab959b62516a88.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2011-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.1 White Selection',
'transmission': 'manual',
'trim': 'White Selection',
'year': 2011}
2026-04-27 07:57:16 [auto1.it] INFO: Saving data for LU21739: {'created_time': 1777276636.457681, 'last_price_update_time': 1777276636.457696, 'has_photos': True, 'auction_closing_time': 1777391942.0}
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763c10>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7e3f5f37b2f0c020c8de725aa78e3b42.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ce129fe4f1469d18bef01b681a0b94c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_71efec5884670cf7053e99e958d7d48c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564cd90>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_40a4848df3947bec22359dacac611246.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 17445644-936d-5071-a996-c16e7ed871f2
2026-04-27 07:57:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 17445644-936d-5071-a996-c16e7ed871f2, skipping ID generation
2026-04-27 07:57:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 17445644-936d-5071-a996-c16e7ed871f2 with scrape type 1
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 17445644-936d-5071-a996-c16e7ed871f2 sending to next pipeline
2026-04-27 07:57:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 17445644-936d-5071-a996-c16e7ed871f2, identifier: HH85669
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5625390>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead634b890>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_8d66057615d7de2773d3c9ccd786b7f0.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5625390>
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg saved to cache
2026-04-27 07:57:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:57:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 17445644-936d-5071-a996-c16e7ed871f2 with identifier: HH85669
2026-04-27 07:57:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 17445644-936d-5071-a996-c16e7ed871f2 with identifier: HH85669
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 17445644-936d-5071-a996-c16e7ed871f2 with identifier: HH85669 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_40a4848df3947bec22359dacac611246.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Brescia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:35:34Z',
'fuel_type': 'gas',
'id': '17445644-936d-5071-a996-c16e7ed871f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5356,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH85669',
'listing': 'auction',
'location': 'IT, Brescia',
'location_confidence': 'geocoded',
'longitude': 10.2147,
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 145966,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_40a4848df3947bec22359dacac611246.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_22ba3793b2b9fc3f75c23b85255c1213.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64814,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_94c02cef0e2eced1ab5ca7b66fc6e62f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_d3f8c7c632fe4a92bb600493ee097852.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b9c1eb31556bbbad5993ad75912ba59e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_3b2e456a56575235aed1547b3347891a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_19c9a0eb39dcf22b71377f32b10f19a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_016fa817441b26fca4838a4026ce5e61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_b3ed930a0a4798222e48cf01ada12bd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_17445644-936d-5071-a996-c16e7ed871f2/17445644-936d-5071-a996-c16e7ed871f2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50915,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/01/b30194e7dc7aa24b1b76124b6f373666/pa/HH85669_034b696cff22389daf657667cdbcf1f2.jpg',
'Width': 800}],
'postal_code': '25100',
'price': 0,
'price_includes_vat': True,
'province': 'Brescia',
'province_code': 'IT-BS',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2013-04-28',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.2 GPL Silver',
'transmission': 'manual',
'trim': 'Silver',
'year': 2013}
2026-04-27 07:57:17 [auto1.it] INFO: Saving data for HH85669: {'created_time': 1777276637.283531, 'last_price_update_time': 1777276637.283546, 'has_photos': True, 'auction_closing_time': 1777390534.0}
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65e0ad0>
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5ae52c6418eb6e993aa8c906dac9255f.jpg saved to cache
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5e81249-bc88-5a5e-87bd-556c5156c372
2026-04-27 07:57:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5e81249-bc88-5a5e-87bd-556c5156c372, skipping ID generation
2026-04-27 07:57:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d5e81249-bc88-5a5e-87bd-556c5156c372 with scrape type 1
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5e81249-bc88-5a5e-87bd-556c5156c372 sending to next pipeline
2026-04-27 07:57:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d5e81249-bc88-5a5e-87bd-556c5156c372, identifier: GR59213
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762850>
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_977019eec6b3666779715f935a8523d0.jpg saved to cache
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566c110>
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg saved to cache
2026-04-27 07:57:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_74b3ddd19887733b7b6585619f66b7b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bb12930c9b8ef570da97d3027583105d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d5e81249-bc88-5a5e-87bd-556c5156c372 with identifier: GR59213
2026-04-27 07:57:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d5e81249-bc88-5a5e-87bd-556c5156c372 with identifier: GR59213
2026-04-27 07:57:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d5e81249-bc88-5a5e-87bd-556c5156c372 with identifier: GR59213 to the API
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5ae52c6418eb6e993aa8c906dac9255f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 190,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:25:29Z',
'fuel_type': 'diesel',
'id': 'd5e81249-bc88-5a5e-87bd-556c5156c372',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR59213',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 154379,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5b9f8022eebdbafc095e7a0d08a021be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78691,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_5ae52c6418eb6e993aa8c906dac9255f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_83b600bb03efe010001a9f202e399d57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_20238bdf985293b8c32d8eb040a9f367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_0777da29987b5e2fd72a2f49e1026ea3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_d555028f77aeedfa2e9f2216923ace64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_a316a9bed73652627e5f310f5d347e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_cb16d489ea7969b98c7ff38def6da19e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_c6ad0c248a2271de0eeefd2f8ffb27f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d5e81249-bc88-5a5e-87bd-556c5156c372/d5e81249-bc88-5a5e-87bd-556c5156c372_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57733,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img96/7e/967e6bbc4dead345049c1b93dd65c426/pa/GR59213_423bea972b7264a094fcb67886138294.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2018-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2018}
2026-04-27 07:57:17 [auto1.it] INFO: Saving data for GR59213: {'created_time': 1777276637.964061, 'last_price_update_time': 1777276637.964073, 'has_photos': True, 'auction_closing_time': 1777389929.0}
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5593110>
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ce129fe4f1469d18bef01b681a0b94c4.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6412fd0>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5514a90>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed6d0>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ce710>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_71efec5884670cf7053e99e958d7d48c.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bf16aa83d660e39c67835eb193b0e311.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ee950>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65afe10>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_74b3ddd19887733b7b6585619f66b7b6.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 144334f5-960b-5ac4-8d04-293507acb064
2026-04-27 07:57:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 144334f5-960b-5ac4-8d04-293507acb064, skipping ID generation
2026-04-27 07:57:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 144334f5-960b-5ac4-8d04-293507acb064 with scrape type 1
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 144334f5-960b-5ac4-8d04-293507acb064 sending to next pipeline
2026-04-27 07:57:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 144334f5-960b-5ac4-8d04-293507acb064, identifier: ZV11200
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0dfd0>
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bb12930c9b8ef570da97d3027583105d.jpg saved to cache
2026-04-27 07:57:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:57:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-04-27 07:57:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200
2026-04-27 07:57:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 144334f5-960b-5ac4-8d04-293507acb064 with identifier: ZV11200 to the API
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_74b3ddd19887733b7b6585619f66b7b6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:12:49Z',
'fuel_type': 'gas',
'id': '144334f5-960b-5ac4-8d04-293507acb064',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZV11200',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Dacia',
'model': 'Duster',
'odometer': 141853,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_1fb0da3985c33b431146b692adff1489.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7901b73886e760853dbea17cf374deb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_74b3ddd19887733b7b6585619f66b7b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ce129fe4f1469d18bef01b681a0b94c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_407ee3ee29789511e79eb94b87f71c39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_fbabbe6f181026294001c74350466250.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57553,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_ebf47de927fb00d43939ef19fb0ba6e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_977019eec6b3666779715f935a8523d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_8d66057615d7de2773d3c9ccd786b7f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_144334f5-960b-5ac4-8d04-293507acb064/144334f5-960b-5ac4-8d04-293507acb064_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/a5/3aa5f9ed04387e3e79d8d93a3dd42aab/pa/ZV11200_7e3f5f37b2f0c020c8de725aa78e3b42.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2016-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe LPG Laureate Family 4x2',
'transmission': 'manual',
'trim': 'Laureate Family 4x2',
'year': 2016}
2026-04-27 07:57:18 [auto1.it] INFO: Saving data for ZV11200: {'created_time': 1777276638.993334, 'last_price_update_time': 1777276638.993347, 'has_photos': True, 'auction_closing_time': 1777389169.0}
2026-04-27 07:57:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_efbcd13d2de6dc65941abe1f80312189.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf2787450>
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg saved to cache
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d8190>
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bf16aa83d660e39c67835eb193b0e311.jpg saved to cache
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab, skipping ID generation
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with scrape type 1
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb6801d0-4a26-5b52-8f5e-3fe39905d0ab sending to next pipeline
2026-04-27 07:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab, identifier: AB63446
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65ad790>
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg saved to cache
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee0d5133-0395-5de4-8feb-3487264009cc
2026-04-27 07:57:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee0d5133-0395-5de4-8feb-3487264009cc, skipping ID generation
2026-04-27 07:57:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee0d5133-0395-5de4-8feb-3487264009cc with scrape type 1
2026-04-27 07:57:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee0d5133-0395-5de4-8feb-3487264009cc sending to next pipeline
2026-04-27 07:57:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ee0d5133-0395-5de4-8feb-3487264009cc, identifier: GV61096
2026-04-27 07:57:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with identifier: AB63446
2026-04-27 07:57:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with identifier: AB63446
2026-04-27 07:57:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cb6801d0-4a26-5b52-8f5e-3fe39905d0ab with identifier: AB63446 to the API
2026-04-27 07:57:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bf16aa83d660e39c67835eb193b0e311.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-04-28T15:45:27Z',
'fuel_type': 'petrol',
'id': 'cb6801d0-4a26-5b52-8f5e-3fe39905d0ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB63446',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 141746,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bf16aa83d660e39c67835eb193b0e311.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104323,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_a8904aebe94432b8df95e53d7e8c6a96.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_bb12930c9b8ef570da97d3027583105d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80796,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_71efec5884670cf7053e99e958d7d48c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cb6801d0-4a26-5b52-8f5e-3fe39905d0ab/cb6801d0-4a26-5b52-8f5e-3fe39905d0ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93359,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/8f/ff8f70f4bdef7d8916f86cd32e5ed242/pa/AB63446_ae9beccfb1acaa342d4ce4483e7d7ac5.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2009-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2009}
2026-04-27 07:57:20 [auto1.it] INFO: Saving data for AB63446: {'created_time': 1777276640.24236, 'last_price_update_time': 1777276640.242375, 'has_photos': True, 'auction_closing_time': 1777391127.0}
2026-04-27 07:57:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-04-27 07:57:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096
2026-04-27 07:57:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:57:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ee0d5133-0395-5de4-8feb-3487264009cc with identifier: GV61096 to the API
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:57:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 224,
'expiration_date': '2026-04-28T15:24:23Z',
'fuel_type': 'hybrid',
'id': 'ee0d5133-0395-5de4-8feb-3487264009cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GV61096',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Peugeot',
'model': '408',
'odometer': 40412,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_397f30f849a6e4eec4728634503d0d75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_e11e1dd9220f1ea6a77aa8af3f7f6757.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_c45d846fad6ce59986ee24bf76428fdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_abfffe4ac8deb80a0c9256f0467d57c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_0e227978d62afa26e03b176e568b61c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_255bbaaa2a0d2cb246b63f242e6ff69f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_d7f593b25e710286b5b15bd42ae71723.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_106146a4e463b4a6e4dc99f8d8d2afbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_9cf4bb47289068ced595f39df327b884.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ee0d5133-0395-5de4-8feb-3487264009cc/ee0d5133-0395-5de4-8feb-3487264009cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/a8/68a8b29649147793bf259e41699d73e8/pa/GV61096_22931f4c002991e2c9d42b9e350c5824.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2024-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 408 1.6 Hybrid GT',
'transmission': 'automatic',
'trim': 'GT',
'year': 2024}
2026-04-27 07:57:20 [auto1.it] INFO: Saving data for GV61096: {'created_time': 1777276640.654706, 'last_price_update_time': 1777276640.654723, 'has_photos': True, 'auction_closing_time': 1777389863.0}
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943750>
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:57:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:57:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_efbcd13d2de6dc65941abe1f80312189.jpg saved to cache
2026-04-27 07:57:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:58:10 [scrapy.extensions.logstats] INFO: Crawled 292 pages (at -8 pages/min), scraped 115 items (at 14 items/min)
2026-04-27 07:58:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WD20154/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG45482/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BK72599> (referer: https://www.auto1.com/v1/car-details-view/BK72599/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-04-27 07:58:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f28ae538cd1ddf99f1539a2ccb3abe9f.jpg not downloaded yet
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f1cf67ace0d5a1e3baa2ee2175754461.jpg not downloaded yet
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f9265e02483ed86be5d6efcbfa0a0b89.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Channel: 24h | Page: 6 | totalHits: 3106 | hits on page: 40
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b7e1255abdbc184b3c2a657eece7afdf.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: HD92307
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for HD92307: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: FT95535
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for FT95535: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: PU50365
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for PU50365: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: JG99232
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for JG99232: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: WR11304
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for WR11304: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DE18860
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DE18860: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DB07340
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DB07340: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: LM83836
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for LM83836: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: FK88663
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for FK88663: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: VF37743
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for VF37743: 0
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: UE39118
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for UE39118: 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_5da54c2b80e62d4ad01a802a39815e65.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: TM14031
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for TM14031: 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_ff4d0f4daf55ed1d14c1f829cc59b2f1.jpg not downloaded yet
2026-04-27 07:58:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WG36727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: AN07953
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for AN07953: 1
2026-04-27 07:58:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_c892751084d30840c09f62b4cc0d8a02.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: FE93281
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for FE93281: 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ec86a44e24181672b944ea630cd97eb.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DP83591
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DP83591: 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b08ddfcd43f628cbf9b2a8fa0b56f902.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: FZ80944
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for FZ80944: 1
2026-04-27 07:58:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ce4375b86eea5f939b6bf2eb02a1a3b.jpg not downloaded yet
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: ZK34576
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for ZK34576: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: MS67358
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for MS67358: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DC04650
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DC04650: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: LR68259
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for LR68259: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DU34377
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DU34377: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: TR34569
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for TR34569: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: PP96260
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for PP96260: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: HD20212
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for HD20212: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: EA93789
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for EA93789: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: AG74645
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for AG74645: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: MJ92101
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for MJ92101: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: HC93680
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for HC93680: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: EU37885
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for EU37885: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: FY15726
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for FY15726: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: XX72461
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for XX72461: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: VG85580
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for VG85580: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: LT53608
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for LT53608: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: WE55630
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for WE55630: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: DN43208
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for DN43208: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: UW55745
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for UW55745: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: PM34750
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for PM34750: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: CE85562
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for CE85562: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: SX71536
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for SX71536: 1
2026-04-27 07:58:26 [auto1.it] INFO: Found listing with ID: MN63848
2026-04-27 07:58:26 [auto1.it] INFO: Scrape type for MN63848: 1
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS56995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM60926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV12122/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RZ82941/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HW42540/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BS94262> (referer: https://www.auto1.com/v1/car-details-view/BS94262/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with identifier: BS94262
2026-04-27 07:58:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with scrape type 1
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_022b54056ef473a4295009e390ae6063.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_f73d755001c2a4ac0b8f7f08e20af554.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_b344bf70ded458ad65c729d392879574.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_e002d8f3b466ea2e77715b43e1db3534.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ef0459260fc9961a75f0fe2a4c02f19d.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_c9ec41e57dcfa061e2e69063539907e3.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_8d32743c35cf1c5e83efa6ad96fa5fe7.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_183e1fbb2434328ed82f06b129859275.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ee4989405207e658174b435658c1dd2b.jpg not downloaded yet
2026-04-27 07:58:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_848cc35e4f48968e9d1cd148fd030898.jpg not downloaded yet
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ89863/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_848cc35e4f48968e9d1cd148fd030898.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EF18991/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ee4989405207e658174b435658c1dd2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53279d0>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_848cc35e4f48968e9d1cd148fd030898.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_183e1fbb2434328ed82f06b129859275.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ec150>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ee4989405207e658174b435658c1dd2b.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab34d0>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_183e1fbb2434328ed82f06b129859275.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_8d32743c35cf1c5e83efa6ad96fa5fe7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a98410>
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_8d32743c35cf1c5e83efa6ad96fa5fe7.jpg saved to cache
2026-04-27 07:58:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG45482> (referer: https://www.auto1.com/v1/car-details-view/AG45482/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-04-27 07:58:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5038ebdd-c153-5905-b20f-05100ee7d5b3 with scrape type 1
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_8c8c1308241d6f1f42023164667c05f7.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_87dfcaaf48f4198b590463024c3a0150.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_113e0078a8aca292046d61f91dc6a5bd.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_27735e638284c1aefb0a731165eee764.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_09b966c992b7104f894ac85166d19ff8.jpg not downloaded yet
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_c9ec41e57dcfa061e2e69063539907e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_73c7c2bfd9e039db53819d4c2f631960.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_393ca50aca65204899526bf2e85ef1a9.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_cd0017b20f76f29091d9720e237f4864.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_ee4c523aaa7925c13a15843631a4f75d.jpg not downloaded yet
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_b56c60a04e5929ae174c277985fd0c9a.jpg not downloaded yet
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56da610>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_c9ec41e57dcfa061e2e69063539907e3.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_09b966c992b7104f894ac85166d19ff8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TM14031/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a94dd0>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_09b966c992b7104f894ac85166d19ff8.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_b56c60a04e5929ae174c277985fd0c9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57609d0>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_b56c60a04e5929ae174c277985fd0c9a.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_ee4c523aaa7925c13a15843631a4f75d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_cd0017b20f76f29091d9720e237f4864.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65af7d0>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_ee4c523aaa7925c13a15843631a4f75d.jpg saved to cache
2026-04-27 07:58:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5768910>
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_cd0017b20f76f29091d9720e237f4864.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_393ca50aca65204899526bf2e85ef1a9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a99190>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_393ca50aca65204899526bf2e85ef1a9.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_73c7c2bfd9e039db53819d4c2f631960.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6482a50>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_73c7c2bfd9e039db53819d4c2f631960.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_27735e638284c1aefb0a731165eee764.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SX71536/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7110>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_27735e638284c1aefb0a731165eee764.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_113e0078a8aca292046d61f91dc6a5bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_87dfcaaf48f4198b590463024c3a0150.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5508110>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_113e0078a8aca292046d61f91dc6a5bd.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_8c8c1308241d6f1f42023164667c05f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a93190>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_87dfcaaf48f4198b590463024c3a0150.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5337450>
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_8c8c1308241d6f1f42023164667c05f7.jpg saved to cache
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5038ebdd-c153-5905-b20f-05100ee7d5b3
2026-04-27 07:58:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5038ebdd-c153-5905-b20f-05100ee7d5b3, skipping ID generation
2026-04-27 07:58:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5038ebdd-c153-5905-b20f-05100ee7d5b3 with scrape type 1
2026-04-27 07:58:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5038ebdd-c153-5905-b20f-05100ee7d5b3 sending to next pipeline
2026-04-27 07:58:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5038ebdd-c153-5905-b20f-05100ee7d5b3, identifier: AG45482
2026-04-27 07:58:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-04-27 07:58:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482
2026-04-27 07:58:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5038ebdd-c153-5905-b20f-05100ee7d5b3 with identifier: AG45482 to the API
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_8c8c1308241d6f1f42023164667c05f7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Varedo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:42:14Z',
'fuel_type': 'diesel',
'id': '5038ebdd-c153-5905-b20f-05100ee7d5b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG45482',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Opel',
'model': 'Grandland X',
'odometer': 225027,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_8c8c1308241d6f1f42023164667c05f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_87dfcaaf48f4198b590463024c3a0150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73929,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_113e0078a8aca292046d61f91dc6a5bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_27735e638284c1aefb0a731165eee764.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_09b966c992b7104f894ac85166d19ff8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_73c7c2bfd9e039db53819d4c2f631960.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_393ca50aca65204899526bf2e85ef1a9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_cd0017b20f76f29091d9720e237f4864.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_ee4c523aaa7925c13a15843631a4f75d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5038ebdd-c153-5905-b20f-05100ee7d5b3/5038ebdd-c153-5905-b20f-05100ee7d5b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/b6/0bb69311057ab8ded5b9f6d7597481c6/pa/AG45482_b56c60a04e5929ae174c277985fd0c9a.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2020-05-28',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.5 CDTI INNOVATION',
'transmission': 'automatic',
'trim': 'INNOVATION',
'year': 2020}
2026-04-27 07:58:47 [auto1.it] INFO: Saving data for AG45482: {'created_time': 1777276727.851719, 'last_price_update_time': 1777276727.851731, 'has_photos': True, 'auction_closing_time': 1777390934.0}
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ef0459260fc9961a75f0fe2a4c02f19d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MN63848/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_e002d8f3b466ea2e77715b43e1db3534.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d6790>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ef0459260fc9961a75f0fe2a4c02f19d.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64100d0>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_e002d8f3b466ea2e77715b43e1db3534.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_b344bf70ded458ad65c729d392879574.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_f73d755001c2a4ac0b8f7f08e20af554.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_022b54056ef473a4295009e390ae6063.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f7290>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_b344bf70ded458ad65c729d392879574.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6412910>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_f73d755001c2a4ac0b8f7f08e20af554.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a310>
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_022b54056ef473a4295009e390ae6063.jpg saved to cache
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851
2026-04-27 07:58:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851, skipping ID generation
2026-04-27 07:58:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with scrape type 1
2026-04-27 07:58:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 sending to next pipeline
2026-04-27 07:58:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851, identifier: BS94262
2026-04-27 07:58:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with identifier: BS94262
2026-04-27 07:58:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with identifier: BS94262
2026-04-27 07:58:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34f0bb21-cd47-5c4a-bff1-17ce1d28e851 with identifier: BS94262 to the API
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_022b54056ef473a4295009e390ae6063.jpg>
{'auction_title': '',
'c_o_2_emission_value': 208,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 250,
'expiration_date': '2026-04-28T15:13:19Z',
'fuel_type': 'diesel',
'id': '34f0bb21-cd47-5c4a-bff1-17ce1d28e851',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BS94262',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Jeep',
'model': 'Grand Cherokee',
'odometer': 153645,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_022b54056ef473a4295009e390ae6063.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_f73d755001c2a4ac0b8f7f08e20af554.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_b344bf70ded458ad65c729d392879574.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_e002d8f3b466ea2e77715b43e1db3534.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ef0459260fc9961a75f0fe2a4c02f19d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_c9ec41e57dcfa061e2e69063539907e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_8d32743c35cf1c5e83efa6ad96fa5fe7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_183e1fbb2434328ed82f06b129859275.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_ee4989405207e658174b435658c1dd2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34f0bb21-cd47-5c4a-bff1-17ce1d28e851/34f0bb21-cd47-5c4a-bff1-17ce1d28e851_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/21/a62141eae3e3ad9102c996755cc3f329/pa/BS94262_848cc35e4f48968e9d1cd148fd030898.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Grand Cherokee 3.0 CRD Overland',
'transmission': 'automatic',
'trim': 'Overland',
'year': 2019}
2026-04-27 07:58:49 [auto1.it] INFO: Saving data for BS94262: {'created_time': 1777276729.584594, 'last_price_update_time': 1777276729.58461, 'has_photos': True, 'auction_closing_time': 1777389199.0}
2026-04-27 07:58:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WD20154> (referer: https://www.auto1.com/v1/car-details-view/WD20154/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with identifier: WD20154
2026-04-27 07:58:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with scrape type 1
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_bdb4d0ef7bb2913bee33b16001ddc89b.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_61dbdfe9287379feb2057803e4eb026c.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_2efbc56afdfc8ecf2097650ca767f49b.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_41a7968659383ed824bbfcb78e065d35.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_f7cbb1bceef0333a7cd423dd1f51aa1c.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_184a695593b98e2a4411c6bd42b4695b.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_ddf61674340a2708306952a3c62abd08.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_a3ec2d315f66614f57ea9c38411ddc0a.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d4b428f14a61e809144329dc951bbd16.jpg not downloaded yet
2026-04-27 07:58:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d69341065dc230680633bf63ae65868f.jpg not downloaded yet
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV12122> (referer: https://www.auto1.com/v1/car-details-view/AV12122/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4616771-1123-580d-8cf0-34aa2287d279 with identifier: AV12122
2026-04-27 07:58:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4616771-1123-580d-8cf0-34aa2287d279 with scrape type 1
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_d142901e66494847d0c0d95d1115f07f.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8f1a9a0e5dd8b707b184509457ee5e99.jpg not downloaded yet
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d69341065dc230680633bf63ae65868f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_41ab6ce5e5e89d155dd51819f67daff5.jpg not downloaded yet
2026-04-27 07:58:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RZ82941> (referer: https://www.auto1.com/v1/car-details-view/RZ82941/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8edf8ee8bd369f3f50537e8d3b89ca4e.jpg not downloaded yet
2026-04-27 07:58:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_9c6b3550d5cdeaa1d40e86f45ad89dfe.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_a9769b832913ee7de3ae2cf5c038e907.jpg not downloaded yet
2026-04-27 07:58:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_58f757a3e7eaccd60820816f43eb7508.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_673bcd2721e29b8b2951a3674c64e406.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_213f3b86c9d8be117bd6b4b08ced652a.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b2a50>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d69341065dc230680633bf63ae65868f.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_c0943b0ad47170363f1857a431f68441.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16772960-9534-5b7f-83e3-7f258b483ee0 with identifier: RZ82941
2026-04-27 07:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16772960-9534-5b7f-83e3-7f258b483ee0 with scrape type 1
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_609f8c7387d82a725415dfd37cae1a7c.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_41ab6ce5e5e89d155dd51819f67daff5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8f1a9a0e5dd8b707b184509457ee5e99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_725f34d1d757796eb0d9b310461ada3d.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_49063e5922769edea9cece77beba32f1.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_2cc9394a7e040a82f9c1d2920b9da29f.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_3cfdac6503295102ec38eae13849a550.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_609f8c7387d82a725415dfd37cae1a7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_ee8f0519c35b972c999ad9da8ca56ba5.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a2121cfdafe1c26101e96c734a9400aa.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_167a79d03891de61b486b5a93efd5e04.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6368ed0>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_41ab6ce5e5e89d155dd51819f67daff5.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6357710>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8f1a9a0e5dd8b707b184509457ee5e99.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_d88de5ed72c820b872143544b6f12736.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_c0943b0ad47170363f1857a431f68441.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_2cc9394a7e040a82f9c1d2920b9da29f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a87eb8ed48b648e7121762b130e8a289.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5627050>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_609f8c7387d82a725415dfd37cae1a7c.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6466490>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_c0943b0ad47170363f1857a431f68441.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58efd10>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_2cc9394a7e040a82f9c1d2920b9da29f.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_167a79d03891de61b486b5a93efd5e04.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_d88de5ed72c820b872143544b6f12736.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM60926> (referer: https://www.auto1.com/v1/car-details-view/VM60926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65e3910>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_167a79d03891de61b486b5a93efd5e04.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a2121cfdafe1c26101e96c734a9400aa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b1710>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_d88de5ed72c820b872143544b6f12736.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-04-27 07:58:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc81d046-8eab-513f-9931-4ce57eb14edb with scrape type 1
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a87eb8ed48b648e7121762b130e8a289.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg not downloaded yet
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5510790>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a2121cfdafe1c26101e96c734a9400aa.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_3cfdac6503295102ec38eae13849a550.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg not downloaded yet
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95e10>
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a87eb8ed48b648e7121762b130e8a289.jpg saved to cache
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg not downloaded yet
2026-04-27 07:58:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_ee8f0519c35b972c999ad9da8ca56ba5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f8290>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab1910>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_3cfdac6503295102ec38eae13849a550.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ89863> (referer: https://www.auto1.com/v1/car-details-view/RJ89863/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58af290>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_ee8f0519c35b972c999ad9da8ca56ba5.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HW42540> (referer: https://www.auto1.com/v1/car-details-view/HW42540/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5395390>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553e450>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a189b4af-7d12-57e4-b82b-6e4a87505def with identifier: RJ89863
2026-04-27 07:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a189b4af-7d12-57e4-b82b-6e4a87505def with scrape type 1
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_c993f081a5b77e1054873b9530d1b6f3.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_6ce84db2dbea9a3b511f6da147a85745.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_3ed12b6bccda0a55c5b58cc88caca411.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6349690>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-04-27 07:58:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with scrape type 1
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f99b72db6d6a3544d84f9be074cd43ac.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f64dd66e3eb3cded705ed9a4bf0ce668.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6349910>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_c993f081a5b77e1054873b9530d1b6f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550f710>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550c990>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_6ce84db2dbea9a3b511f6da147a85745.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f64dd66e3eb3cded705ed9a4bf0ce668.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af4450>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5334b50>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_c993f081a5b77e1054873b9530d1b6f3.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550d390>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg not downloaded yet
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg not downloaded yet
2026-04-27 07:58:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f99b72db6d6a3544d84f9be074cd43ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg not downloaded yet
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5751250>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed890>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_6ce84db2dbea9a3b511f6da147a85745.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63aabd0>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f64dd66e3eb3cded705ed9a4bf0ce668.jpg saved to cache
2026-04-27 07:58:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6474d90>
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ac5710>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f99b72db6d6a3544d84f9be074cd43ac.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6444790>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784d10>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6475b10>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a9490>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5626590>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_3ed12b6bccda0a55c5b58cc88caca411.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_49063e5922769edea9cece77beba32f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead570b450>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5327c90>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_725f34d1d757796eb0d9b310461ada3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SX71536> (referer: https://www.auto1.com/v1/car-details-view/SX71536/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64643d0>
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg saved to cache
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bc81d046-8eab-513f-9931-4ce57eb14edb
2026-04-27 07:58:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bc81d046-8eab-513f-9931-4ce57eb14edb, skipping ID generation
2026-04-27 07:58:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc81d046-8eab-513f-9931-4ce57eb14edb with scrape type 1
2026-04-27 07:58:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bc81d046-8eab-513f-9931-4ce57eb14edb sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bc81d046-8eab-513f-9931-4ce57eb14edb, identifier: VM60926
2026-04-27 07:58:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-04-27 07:58:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926
2026-04-27 07:58:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bc81d046-8eab-513f-9931-4ce57eb14edb with identifier: VM60926 to the API
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Reggio Emilia',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:14:11Z',
'fuel_type': 'diesel',
'id': 'bc81d046-8eab-513f-9931-4ce57eb14edb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM60926',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 196835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_0d3249c4e9c5918f7cbd6e05d74f681c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2e765a6e84c742415cb47bcf4dc706e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_a1d206684b49207ffce4e50d3ca7b987.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54949,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_94fe17537953e8b0c771bf43301b6b89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_1184f32157a807fbd734c8d7a5bec780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69665,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_e2e3a0513249b8c388197cea2a00a267.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_81cf1cdfcc35ca562434e9bbb9920e1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_f2c8efc17a13e52afea2f0e843ef9da7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_45c93bfed82a62b1c2c6cebdbf89bf24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bc81d046-8eab-513f-9931-4ce57eb14edb/bc81d046-8eab-513f-9931-4ce57eb14edb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/8d/2b8dafee63271b3329bd02e1d6cfe41b/pa/VM60926_2756cf9168c54399328f52bd88e9fe59.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Advance BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Advance BlueMotion Tech',
'year': 2019}
2026-04-27 07:58:54 [auto1.it] INFO: Saving data for VM60926: {'created_time': 1777276734.487149, 'last_price_update_time': 1777276734.487161, 'has_photos': True, 'auction_closing_time': 1777389251.0}
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_58f757a3e7eaccd60820816f43eb7508.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_a9769b832913ee7de3ae2cf5c038e907.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_213f3b86c9d8be117bd6b4b08ced652a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_673bcd2721e29b8b2951a3674c64e406.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59472d0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a066538d-7da0-5fa1-9ad8-d49e9e4dd038, skipping ID generation
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a066538d-7da0-5fa1-9ad8-d49e9e4dd038 sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a066538d-7da0-5fa1-9ad8-d49e9e4dd038, identifier: HW42540
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55115d0>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_3ed12b6bccda0a55c5b58cc88caca411.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a189b4af-7d12-57e4-b82b-6e4a87505def
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a189b4af-7d12-57e4-b82b-6e4a87505def, skipping ID generation
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a189b4af-7d12-57e4-b82b-6e4a87505def with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a189b4af-7d12-57e4-b82b-6e4a87505def sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a189b4af-7d12-57e4-b82b-6e4a87505def, identifier: RJ89863
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95c10>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_49063e5922769edea9cece77beba32f1.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56dc050>
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_725f34d1d757796eb0d9b310461ada3d.jpg saved to cache
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 16772960-9534-5b7f-83e3-7f258b483ee0
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 16772960-9534-5b7f-83e3-7f258b483ee0, skipping ID generation
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16772960-9534-5b7f-83e3-7f258b483ee0 with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 16772960-9534-5b7f-83e3-7f258b483ee0 sending to next pipeline
2026-04-27 07:58:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 16772960-9534-5b7f-83e3-7f258b483ee0, identifier: RZ82941
2026-04-27 07:58:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-04-27 07:58:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7ad6d0-a179-5410-985c-d85258b21310 with scrape type 1
2026-04-27 07:58:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg not downloaded yet
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a066538d-7da0-5fa1-9ad8-d49e9e4dd038 with identifier: HW42540 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:51:54Z',
'fuel_type': 'diesel',
'id': 'a066538d-7da0-5fa1-9ad8-d49e9e4dd038',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HW42540',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 113222,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65372,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f0f7eaf30a423e21689a445bb751ff51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_a7d1ea92076b6f8ff16e6f62f32d4f6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67606,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_9ac384b762dbc8b2b1bad81bca3d67f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_92dc253c5c99f7b0037875ea4cad6097.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_ca4d66332e7317812367536a4da5578a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_f1f339267911872429dda550bbb09726.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_502e0358aef8c0944168980706c16ecf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_3d5691a6781610fad29a19a6c8e62be8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_6d16c6b1d218619282124a873c71a291.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a066538d-7da0-5fa1-9ad8-d49e9e4dd038/a066538d-7da0-5fa1-9ad8-d49e9e4dd038_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img68/01/6801f57736042e19b00b54d493171457/pa/HW42540_5cf49b3772f17f9d4ba809f541d954ef.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2018-03-29',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2018}
2026-04-27 07:58:55 [auto1.it] INFO: Saving data for HW42540: {'created_time': 1777276735.326131, 'last_price_update_time': 1777276735.326142, 'has_photos': True, 'auction_closing_time': 1777391514.0}
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a189b4af-7d12-57e4-b82b-6e4a87505def with identifier: RJ89863
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a189b4af-7d12-57e4-b82b-6e4a87505def with identifier: RJ89863
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a189b4af-7d12-57e4-b82b-6e4a87505def with identifier: RJ89863 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_3ed12b6bccda0a55c5b58cc88caca411.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'Capua',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-04-28T15:50:37Z',
'fuel_type': 'diesel',
'id': 'a189b4af-7d12-57e4-b82b-6e4a87505def',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ89863',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Opel',
'model': 'Insignia',
'odometer': 345073,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93751,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_c993f081a5b77e1054873b9530d1b6f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_6ce84db2dbea9a3b511f6da147a85745.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86184,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_3ed12b6bccda0a55c5b58cc88caca411.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f99b72db6d6a3544d84f9be074cd43ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a189b4af-7d12-57e4-b82b-6e4a87505def/a189b4af-7d12-57e4-b82b-6e4a87505def_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaa/f6/aaf675f545de43f1194d52b1c4a3a1da/pa/RJ89863_f64dd66e3eb3cded705ed9a4bf0ce668.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2011-12-13',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia 2.0 CDTI Cosmo 4x4',
'transmission': 'manual',
'trim': 'Cosmo 4x4',
'year': 2011}
2026-04-27 07:58:55 [auto1.it] INFO: Saving data for RJ89863: {'created_time': 1777276735.640072, 'last_price_update_time': 1777276735.640085, 'has_photos': True, 'auction_closing_time': 1777391437.0}
2026-04-27 07:58:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 16772960-9534-5b7f-83e3-7f258b483ee0 with identifier: RZ82941
2026-04-27 07:58:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 16772960-9534-5b7f-83e3-7f258b483ee0 with identifier: RZ82941
2026-04-27 07:58:55 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 16772960-9534-5b7f-83e3-7f258b483ee0 with identifier: RZ82941 to the API
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:55 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_725f34d1d757796eb0d9b310461ada3d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'city': 'Milazzo',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:11:59Z',
'fuel_type': 'diesel',
'id': '16772960-9534-5b7f-83e3-7f258b483ee0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RZ82941',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Seat',
'model': 'Tarraco',
'odometer': 148021,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_609f8c7387d82a725415dfd37cae1a7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_725f34d1d757796eb0d9b310461ada3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_49063e5922769edea9cece77beba32f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_2cc9394a7e040a82f9c1d2920b9da29f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68428,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_3cfdac6503295102ec38eae13849a550.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70375,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_ee8f0519c35b972c999ad9da8ca56ba5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a2121cfdafe1c26101e96c734a9400aa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95371,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_167a79d03891de61b486b5a93efd5e04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81276,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_d88de5ed72c820b872143544b6f12736.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_16772960-9534-5b7f-83e3-7f258b483ee0/16772960-9534-5b7f-83e3-7f258b483ee0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/53/765347d387ed017803a1546289b65efd/pa/RZ82941_a87eb8ed48b648e7121762b130e8a289.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2022-05-11',
'seats_number': 7,
'seller_name': None,
'title': 'Seat Tarraco 2.0 TDI Style',
'transmission': 'automatic',
'trim': 'Style',
'year': 2022}
2026-04-27 07:58:55 [auto1.it] INFO: Saving data for RZ82941: {'created_time': 1777276735.986016, 'last_price_update_time': 1777276735.986025, 'has_photos': True, 'auction_closing_time': 1777389119.0}
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_9c6b3550d5cdeaa1d40e86f45ad89dfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TM14031> (referer: https://www.auto1.com/v1/car-details-view/TM14031/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EF18991> (referer: https://www.auto1.com/v1/car-details-view/EF18991/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a965d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_58f757a3e7eaccd60820816f43eb7508.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a8b110>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_a9769b832913ee7de3ae2cf5c038e907.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead573a910>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_213f3b86c9d8be117bd6b4b08ced652a.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649eb10>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_673bcd2721e29b8b2951a3674c64e406.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_d142901e66494847d0c0d95d1115f07f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d4b428f14a61e809144329dc951bbd16.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg not downloaded yet
2026-04-27 07:58:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_ddf61674340a2708306952a3c62abd08.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_a3ec2d315f66614f57ea9c38411ddc0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6488390>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_9c6b3550d5cdeaa1d40e86f45ad89dfe.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with identifier: TM14031
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_51f449d511068d088112a38d3439da59.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700def29-5a43-5808-a6f8-f7b39123184b with identifier: EF18991
2026-04-27 07:58:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700def29-5a43-5808-a6f8-f7b39123184b with scrape type 1
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_36a1ee5172326af2f4ed62abb0b93be4.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_0b7e6a4b1669875d124c63f8f014ff7d.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_3662710c15c664fd3e626df8d99df8b4.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7457346c8cede4ecb361217c17b8531.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_d25f78bd2e5a3cf21af82dcd51ef8a76.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_f7cbb1bceef0333a7cd423dd1f51aa1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_184a695593b98e2a4411c6bd42b4695b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_41a7968659383ed824bbfcb78e065d35.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8edf8ee8bd369f3f50537e8d3b89ca4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665390>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_d142901e66494847d0c0d95d1115f07f.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f5050>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d4b428f14a61e809144329dc951bbd16.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ee4d0>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_ddf61674340a2708306952a3c62abd08.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567c290>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_a3ec2d315f66614f57ea9c38411ddc0a.jpg saved to cache
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7087d5662353d067621c182d5b1ee66.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_78aa624f49f76fb4a33ef92fdd68884b.jpg not downloaded yet
2026-04-27 07:58:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_36a1ee5172326af2f4ed62abb0b93be4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_c9d9a476cd635ff5b265b6f6cb015664.jpg not downloaded yet
2026-04-27 07:58:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_4fedca1cfb871ff738b8196a1a76ff10.jpg not downloaded yet
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64ba950>
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555a8d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64663d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_f7cbb1bceef0333a7cd423dd1f51aa1c.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e49d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_184a695593b98e2a4411c6bd42b4695b.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566c2d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_41a7968659383ed824bbfcb78e065d35.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bdd50>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8edf8ee8bd369f3f50537e8d3b89ca4e.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d4616771-1123-580d-8cf0-34aa2287d279
2026-04-27 07:58:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d4616771-1123-580d-8cf0-34aa2287d279, skipping ID generation
2026-04-27 07:58:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4616771-1123-580d-8cf0-34aa2287d279 with scrape type 1
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d4616771-1123-580d-8cf0-34aa2287d279 sending to next pipeline
2026-04-27 07:58:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d4616771-1123-580d-8cf0-34aa2287d279, identifier: AV12122
2026-04-27 07:58:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d4616771-1123-580d-8cf0-34aa2287d279 with identifier: AV12122
2026-04-27 07:58:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d4616771-1123-580d-8cf0-34aa2287d279 with identifier: AV12122
2026-04-27 07:58:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d4616771-1123-580d-8cf0-34aa2287d279 with identifier: AV12122 to the API
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8edf8ee8bd369f3f50537e8d3b89ca4e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Settimo Torinese',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:24:41Z',
'fuel_type': 'diesel',
'id': 'd4616771-1123-580d-8cf0-34aa2287d279',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV12122',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Audi',
'model': 'A4',
'odometer': 218988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70401,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_d142901e66494847d0c0d95d1115f07f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8f1a9a0e5dd8b707b184509457ee5e99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_41ab6ce5e5e89d155dd51819f67daff5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56377,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_8edf8ee8bd369f3f50537e8d3b89ca4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_9c6b3550d5cdeaa1d40e86f45ad89dfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_a9769b832913ee7de3ae2cf5c038e907.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47479,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_58f757a3e7eaccd60820816f43eb7508.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_673bcd2721e29b8b2951a3674c64e406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_213f3b86c9d8be117bd6b4b08ced652a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d4616771-1123-580d-8cf0-34aa2287d279/d4616771-1123-580d-8cf0-34aa2287d279_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img62/08/62080eb6c344bd935940630f8a2a47c6/pa/AV12122_c0943b0ad47170363f1857a431f68441.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2018-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A4 2.0 TDI Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2018}
2026-04-27 07:58:57 [auto1.it] INFO: Saving data for AV12122: {'created_time': 1777276737.774677, 'last_price_update_time': 1777276737.774689, 'has_photos': True, 'auction_closing_time': 1777389881.0}
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_51f449d511068d088112a38d3439da59.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_61dbdfe9287379feb2057803e4eb026c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg not downloaded yet
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_715fe7c344c820a13d4799c61e6a06c1.jpg not downloaded yet
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_2efbc56afdfc8ecf2097650ca767f49b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_3662710c15c664fd3e626df8d99df8b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_0b7e6a4b1669875d124c63f8f014ff7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS56995> (referer: https://www.auto1.com/v1/car-details-view/MS56995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CE85562/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MN63848> (referer: https://www.auto1.com/v1/car-details-view/MN63848/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ27868/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5584590>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_36a1ee5172326af2f4ed62abb0b93be4.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5585390>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_51f449d511068d088112a38d3439da59.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53389d0>
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_61dbdfe9287379feb2057803e4eb026c.jpg saved to cache
2026-04-27 07:58:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_78aa624f49f76fb4a33ef92fdd68884b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_4fedca1cfb871ff738b8196a1a76ff10.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_c9d9a476cd635ff5b265b6f6cb015664.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580dad0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ddbd0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_2efbc56afdfc8ecf2097650ca767f49b.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6465290>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56dd150>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_3662710c15c664fd3e626df8d99df8b4.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5739450>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_0b7e6a4b1669875d124c63f8f014ff7d.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c51cb334-667e-587a-9e0a-ee5dae621b9c with identifier: MS56995
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51cb334-667e-587a-9e0a-ee5dae621b9c with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_438c46811c597eeb641044e48b650e1d.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7087d5662353d067621c182d5b1ee66.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7457346c8cede4ecb361217c17b8531.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_d25f78bd2e5a3cf21af82dcd51ef8a76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_5e3df63b9a96ec1db6bcada35b3c4674.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg not downloaded yet
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_c6986489f2c3e1b6fb8cd90686943767.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg not downloaded yet
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5819c10>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_78aa624f49f76fb4a33ef92fdd68884b.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553d1d0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_4fedca1cfb871ff738b8196a1a76ff10.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567ba90>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_c9d9a476cd635ff5b265b6f6cb015664.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_cc2c501e182aa541787470a34a4c4628.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg not downloaded yet
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_438c46811c597eeb641044e48b650e1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_bdb4d0ef7bb2913bee33b16001ddc89b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_715fe7c344c820a13d4799c61e6a06c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_7f2b07813b36da57f9bb65bd236fcaa6.jpg not downloaded yet
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg not downloaded yet
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead546f610>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7087d5662353d067621c182d5b1ee66.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562b610>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7457346c8cede4ecb361217c17b8531.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2
2026-04-27 07:58:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2, skipping ID generation
2026-04-27 07:58:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with scrape type 1
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 sending to next pipeline
2026-04-27 07:58:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2, identifier: TM14031
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555b350>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6445210>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_d25f78bd2e5a3cf21af82dcd51ef8a76.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5940ad0>
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg saved to cache
2026-04-27 07:58:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with identifier: TM14031
2026-04-27 07:58:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-04-27 07:58:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 07:58:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with identifier: TM14031
2026-04-27 07:58:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:58:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 10c0d274-4f05-551c-8ad2-754f8d2d5fa2 with identifier: TM14031 to the API
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:58:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7457346c8cede4ecb361217c17b8531.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Padova',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:41:25Z',
'fuel_type': 'petrol',
'id': '10c0d274-4f05-551c-8ad2-754f8d2d5fa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM14031',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Lancia',
'model': 'Delta',
'odometer': 280530,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_51f449d511068d088112a38d3439da59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_0b7e6a4b1669875d124c63f8f014ff7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7457346c8cede4ecb361217c17b8531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_e7087d5662353d067621c182d5b1ee66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_10c0d274-4f05-551c-8ad2-754f8d2d5fa2/10c0d274-4f05-551c-8ad2-754f8d2d5fa2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/e4/94e4ec61c1d5018125b109b9afe7a8e5/pa/TM14031_c9d9a476cd635ff5b265b6f6cb015664.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2012-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Delta 1.4 Turbo Oro',
'transmission': 'manual',
'trim': 'Oro',
'year': 2012}
2026-04-27 07:58:59 [auto1.it] INFO: Saving data for TM14031: {'created_time': 1777276739.436678, 'last_price_update_time': 1777276739.436693, 'has_photos': True, 'auction_closing_time': 1777390885.0}
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a273d78fcf8e6123e20247312ee837a2.jpg not downloaded yet
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg not downloaded yet
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83aca10>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6490>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550e990>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562b190>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_438c46811c597eeb641044e48b650e1d.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ac51d0>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_bdb4d0ef7bb2913bee33b16001ddc89b.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29
2026-04-27 07:58:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 227c4498-72c4-5dc9-8c27-bb3236ed4e29, skipping ID generation
2026-04-27 07:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with scrape type 1
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 227c4498-72c4-5dc9-8c27-bb3236ed4e29 sending to next pipeline
2026-04-27 07:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 227c4498-72c4-5dc9-8c27-bb3236ed4e29, identifier: WD20154
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56db150>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6890>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:58:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_715fe7c344c820a13d4799c61e6a06c1.jpg saved to cache
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 700def29-5a43-5808-a6f8-f7b39123184b
2026-04-27 07:58:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 700def29-5a43-5808-a6f8-f7b39123184b, skipping ID generation
2026-04-27 07:58:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700def29-5a43-5808-a6f8-f7b39123184b with scrape type 1
2026-04-27 07:58:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 700def29-5a43-5808-a6f8-f7b39123184b sending to next pipeline
2026-04-27 07:58:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 700def29-5a43-5808-a6f8-f7b39123184b, identifier: EF18991
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c9910>
2026-04-27 07:58:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg saved to cache
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b7ad6d0-a179-5410-985c-d85258b21310
2026-04-27 07:59:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b7ad6d0-a179-5410-985c-d85258b21310, skipping ID generation
2026-04-27 07:59:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b7ad6d0-a179-5410-985c-d85258b21310 with scrape type 1
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b7ad6d0-a179-5410-985c-d85258b21310 sending to next pipeline
2026-04-27 07:59:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 5b7ad6d0-a179-5410-985c-d85258b21310, identifier: SX71536
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_6afd3153860b0afc89fd85543b08e8e8.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg not downloaded yet
2026-04-27 07:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with identifier: WD20154
2026-04-27 07:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with identifier: WD20154
2026-04-27 07:59:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 227c4498-72c4-5dc9-8c27-bb3236ed4e29 with identifier: WD20154 to the API
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_bdb4d0ef7bb2913bee33b16001ddc89b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Capannori',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:14:00Z',
'fuel_type': 'diesel',
'id': '227c4498-72c4-5dc9-8c27-bb3236ed4e29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WD20154',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Dacia',
'model': 'Logan MCV',
'odometer': 319995,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_bdb4d0ef7bb2913bee33b16001ddc89b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57092,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_61dbdfe9287379feb2057803e4eb026c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_2efbc56afdfc8ecf2097650ca767f49b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_41a7968659383ed824bbfcb78e065d35.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_f7cbb1bceef0333a7cd423dd1f51aa1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63316,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_184a695593b98e2a4411c6bd42b4695b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_ddf61674340a2708306952a3c62abd08.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_a3ec2d315f66614f57ea9c38411ddc0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d4b428f14a61e809144329dc951bbd16.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_227c4498-72c4-5dc9-8c27-bb3236ed4e29/227c4498-72c4-5dc9-8c27-bb3236ed4e29_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/49/9b49b08e33b0560230a219fc69a8b4f5/pa/WD20154_d69341065dc230680633bf63ae65868f.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2013-10-17',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Logan MCV 1.5 dCi Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2013}
2026-04-27 07:59:00 [auto1.it] INFO: Saving data for WD20154: {'created_time': 1777276740.586278, 'last_price_update_time': 1777276740.586289, 'has_photos': True, 'auction_closing_time': 1777389240.0}
2026-04-27 07:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 700def29-5a43-5808-a6f8-f7b39123184b with identifier: EF18991
2026-04-27 07:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 700def29-5a43-5808-a6f8-f7b39123184b with identifier: EF18991
2026-04-27 07:59:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 700def29-5a43-5808-a6f8-f7b39123184b with identifier: EF18991 to the API
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_715fe7c344c820a13d4799c61e6a06c1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:33:54Z',
'fuel_type': 'petrol',
'id': '700def29-5a43-5808-a6f8-f7b39123184b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EF18991',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Alfa Romeo',
'model': 'MiTo',
'odometer': 181406,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_36a1ee5172326af2f4ed62abb0b93be4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_3662710c15c664fd3e626df8d99df8b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_d25f78bd2e5a3cf21af82dcd51ef8a76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_78aa624f49f76fb4a33ef92fdd68884b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_4fedca1cfb871ff738b8196a1a76ff10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_700def29-5a43-5808-a6f8-f7b39123184b/700def29-5a43-5808-a6f8-f7b39123184b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/cb/01cb9c94e6cc5beec530d8717a5bb4ef/pa/EF18991_715fe7c344c820a13d4799c61e6a06c1.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2010-06-09',
'seats_number': 4,
'seller_name': None,
'title': 'Alfa Romeo MiTo 1.4 Distinctive',
'transmission': 'manual',
'trim': 'Distinctive',
'year': 2010}
2026-04-27 07:59:00 [auto1.it] INFO: Saving data for EF18991: {'created_time': 1777276740.951317, 'last_price_update_time': 1777276740.951329, 'has_photos': True, 'auction_closing_time': 1777390434.0}
2026-04-27 07:59:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-04-27 07:59:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536
2026-04-27 07:59:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5b7ad6d0-a179-5410-985c-d85258b21310 with identifier: SX71536 to the API
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg>
{'auction_title': '',
'c_o_2_emission_value': 194,
'category': None,
'city': 'Senago',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:48:54Z',
'fuel_type': 'diesel',
'id': '5b7ad6d0-a179-5410-985c-d85258b21310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SX71536',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 199147,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_43377955fbb3e7ca0696618d850078c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_fd8b7d2ac97930233fb6a2ac09f7ca75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67673,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_7a7e019ae5eaea991df2a129126cbc81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_67c6dfe42b3d913f8417eb988dfcf147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_86514e277eef9dc106c6cc3138bfff7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_6252f5722555e4b943bd6c09170ece23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_15c88d53f7a1555ba55cb4571b0c365e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_9ff9fa67d7d3c368792927de48fc209b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_aede7d67c1f09ef31361085f0209ccd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5b7ad6d0-a179-5410-985c-d85258b21310/5b7ad6d0-a179-5410-985c-d85258b21310_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/39/9239951af54b761acc60b75d1c70cc9d/pa/SX71536_cc4eb042c61fd15a4f4b69c8885470e9.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2010-04-20',
'seats_number': 7,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.2 DI-D Instyle 4WD',
'transmission': 'manual',
'trim': 'Instyle 4WD',
'year': 2010}
2026-04-27 07:59:01 [auto1.it] INFO: Saving data for SX71536: {'created_time': 1777276741.459234, 'last_price_update_time': 1777276741.459248, 'has_photos': True, 'auction_closing_time': 1777391334.0}
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_cc2c501e182aa541787470a34a4c4628.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_c6986489f2c3e1b6fb8cd90686943767.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_5e3df63b9a96ec1db6bcada35b3c4674.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_1fac58ab70404aa2c6710d66272a6491.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a8188c7d67083a13901d81cefb32030e.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_0157c14b679eb61dbb2592921cb6f39a.jpg not downloaded yet
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg not downloaded yet
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_7f2b07813b36da57f9bb65bd236fcaa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a273d78fcf8e6123e20247312ee837a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_6afd3153860b0afc89fd85543b08e8e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56de7d0>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_cc2c501e182aa541787470a34a4c4628.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f7a90>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_c6986489f2c3e1b6fb8cd90686943767.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bd010>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg saved to cache
2026-04-27 07:59:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557f650>
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_5e3df63b9a96ec1db6bcada35b3c4674.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533b510>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f5c50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589c910>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_7f2b07813b36da57f9bb65bd236fcaa6.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6409090>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a273d78fcf8e6123e20247312ee837a2.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5492750>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_6afd3153860b0afc89fd85543b08e8e8.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_0157c14b679eb61dbb2592921cb6f39a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a8188c7d67083a13901d81cefb32030e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533ebd0>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587b2d0>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59524d0>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659fad0>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CE85562> (referer: https://www.auto1.com/v1/car-details-view/CE85562/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UW55745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PM34750/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533ff10>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_0157c14b679eb61dbb2592921cb6f39a.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a1e50>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a8188c7d67083a13901d81cefb32030e.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead573b110>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_1fac58ab70404aa2c6710d66272a6491.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ27868> (referer: https://www.auto1.com/v1/car-details-view/HZ27868/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593e750>
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg saved to cache
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c
2026-04-27 07:59:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c, skipping ID generation
2026-04-27 07:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with scrape type 1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 446c9d9f-984f-51fb-ad7a-b3fac5eea97c sending to next pipeline
2026-04-27 07:59:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c, identifier: MN63848
2026-04-27 07:59:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with identifier: CE85562
2026-04-27 07:59:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with scrape type 1
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6a5930a4871aeb873094a188e5c77a42.jpg not downloaded yet
2026-04-27 07:59:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-04-27 07:59:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848
2026-04-27 07:59:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 446c9d9f-984f-51fb-ad7a-b3fac5eea97c with identifier: MN63848 to the API
2026-04-27 07:59:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 179,
'category': None,
'city': 'Bentivoglio',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '3.0L',
'engine_horse_power': 258,
'expiration_date': '2026-04-28T15:26:15Z',
'fuel_type': 'diesel',
'id': '446c9d9f-984f-51fb-ad7a-b3fac5eea97c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6369,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MN63848',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'location_confidence': 'geocoded',
'longitude': 11.4174,
'make': 'Mercedes-Benz',
'model': 'GLE-Klasse',
'odometer': 196695,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89469,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_766e9c695aa178c31e69322cb6b3b6db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_82530a980651e9425ef554d1ef4dd9c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_5041c086462b694b0f8094a7a90aa0ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_c50bb63112347d529c2b567bb748ce3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_90124fd30bc05d3d6cd5ef0805ae131e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_08bc523b3fcab1368b9aec2d23e41777.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63110,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d6d2258fcbaac85fd5b183ff7d3aa9ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_d292d9297acc87c1e6ddf28457e8206f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_beece74efd670c7a6d6954b908745873.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_446c9d9f-984f-51fb-ad7a-b3fac5eea97c/446c9d9f-984f-51fb-ad7a-b3fac5eea97c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img91/b4/91b4aaa4a3fc3557fe442b818a528573/pa/MN63848_db3e0e0624360f16d3d68e205c451f38.jpg',
'Width': 800}],
'postal_code': '40010',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2017-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLE-Klasse GLE 350 d 4Matic Premium',
'transmission': 'automatic',
'trim': '4Matic Premium',
'year': 2017}
2026-04-27 07:59:03 [auto1.it] INFO: Saving data for MN63848: {'created_time': 1777276743.180774, 'last_price_update_time': 1777276743.180784, 'has_photos': True, 'auction_closing_time': 1777389975.0}
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_aa876258f43a9f6141cdba0a24f7dbb4.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_dfa7a1a158821694270434d8bed91c39.jpg not downloaded yet
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6369d10>
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_1fac58ab70404aa2c6710d66272a6491.jpg saved to cache
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c51cb334-667e-587a-9e0a-ee5dae621b9c
2026-04-27 07:59:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c51cb334-667e-587a-9e0a-ee5dae621b9c, skipping ID generation
2026-04-27 07:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c51cb334-667e-587a-9e0a-ee5dae621b9c with scrape type 1
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c51cb334-667e-587a-9e0a-ee5dae621b9c sending to next pipeline
2026-04-27 07:59:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c51cb334-667e-587a-9e0a-ee5dae621b9c, identifier: MS56995
2026-04-27 07:59:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c80ae525-19ab-5bea-a59a-9791b4e8bd7d with identifier: HZ27868
2026-04-27 07:59:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d with scrape type 1
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_6c0ad6735e1653eb26cc938c5904cada.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_347accc8c86aa1f19bf9367995ffb45c.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c51cb334-667e-587a-9e0a-ee5dae621b9c with identifier: MS56995
2026-04-27 07:59:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c51cb334-667e-587a-9e0a-ee5dae621b9c with identifier: MS56995
2026-04-27 07:59:03 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c51cb334-667e-587a-9e0a-ee5dae621b9c with identifier: MS56995 to the API
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_1fac58ab70404aa2c6710d66272a6491.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:55:47Z',
'fuel_type': 'diesel',
'id': 'c51cb334-667e-587a-9e0a-ee5dae621b9c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS56995',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Seat',
'model': 'Altea',
'odometer': 156994,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_438c46811c597eeb641044e48b650e1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74006,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_5e3df63b9a96ec1db6bcada35b3c4674.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67417,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_c6986489f2c3e1b6fb8cd90686943767.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_cc2c501e182aa541787470a34a4c4628.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_7f2b07813b36da57f9bb65bd236fcaa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65708,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a273d78fcf8e6123e20247312ee837a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63342,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_6afd3153860b0afc89fd85543b08e8e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75118,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_1fac58ab70404aa2c6710d66272a6491.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_a8188c7d67083a13901d81cefb32030e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c51cb334-667e-587a-9e0a-ee5dae621b9c/c51cb334-667e-587a-9e0a-ee5dae621b9c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/4d/8a4d8feacb8daae0cc84320223828eef/pa/MS56995_0157c14b679eb61dbb2592921cb6f39a.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2015-06-28',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Altea 1.6 TDI I-Tech',
'transmission': 'automatic',
'trim': 'I-Tech',
'year': 2015}
2026-04-27 07:59:03 [auto1.it] INFO: Saving data for MS56995: {'created_time': 1777276743.770852, 'last_price_update_time': 1777276743.770864, 'has_photos': True, 'auction_closing_time': 1777391747.0}
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_cbcb9f286742f574254c8f77ff38e5e2.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_19a2a3bf4443fa1e83435db693143899.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_834afb2d71d541721a51c929573d9407.jpg not downloaded yet
2026-04-27 07:59:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6c917072a7664d2f6f3885566569646e.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_99448036f896842ae172b9beecf0b5d5.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_47818fc18b2449a2e718044c5883fa85.jpg not downloaded yet
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT53608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DN43208/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_76dd13e5f9a48e1a2007e6d526477dc4.jpg not downloaded yet
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_7b96880c3f1ae02024aa4c4d95c8e321.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ebf1bed9221003f866615897bd1bed21.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_aa5d8e8bf89979918b23a9954595a80b.jpg not downloaded yet
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ce59f19c1ab6f8ef89a9f30f588dc1bc.jpg not downloaded yet
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_47818fc18b2449a2e718044c5883fa85.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_99448036f896842ae172b9beecf0b5d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6590>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_47818fc18b2449a2e718044c5883fa85.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VG85580/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54bb4d0>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_99448036f896842ae172b9beecf0b5d5.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ce59f19c1ab6f8ef89a9f30f588dc1bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5951890>
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ce59f19c1ab6f8ef89a9f30f588dc1bc.jpg saved to cache
2026-04-27 07:59:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XX72461/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FY15726/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_aa5d8e8bf89979918b23a9954595a80b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3ad0>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_aa5d8e8bf89979918b23a9954595a80b.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ebf1bed9221003f866615897bd1bed21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55838d0>
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ebf1bed9221003f866615897bd1bed21.jpg saved to cache
2026-04-27 07:59:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ92101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_7b96880c3f1ae02024aa4c4d95c8e321.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52d10>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_7b96880c3f1ae02024aa4c4d95c8e321.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU37885/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_76dd13e5f9a48e1a2007e6d526477dc4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589cdd0>
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_76dd13e5f9a48e1a2007e6d526477dc4.jpg saved to cache
2026-04-27 07:59:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AG74645/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HC93680/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6c917072a7664d2f6f3885566569646e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52a50>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6c917072a7664d2f6f3885566569646e.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_834afb2d71d541721a51c929573d9407.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5583ad0>
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_834afb2d71d541721a51c929573d9407.jpg saved to cache
2026-04-27 07:59:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HD20212/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_19a2a3bf4443fa1e83435db693143899.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548efd0>
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_19a2a3bf4443fa1e83435db693143899.jpg saved to cache
2026-04-27 07:59:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:10 [scrapy.extensions.logstats] INFO: Crawled 336 pages (at 44 pages/min), scraped 128 items (at 13 items/min)
2026-04-27 07:59:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DN43208> (referer: https://www.auto1.com/v1/car-details-view/DN43208/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7797d812-f98c-5658-87f7-d5236eccc7bb with identifier: DN43208
2026-04-27 07:59:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7797d812-f98c-5658-87f7-d5236eccc7bb with scrape type 1
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_46baf8ec6de0337418ad6d0ae0ae9a99.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_41b1941cbc1fdee6f2c76d059fe67d09.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6cc0ad5599cce11ef2b3c775f1d29bca.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_8c5272e14ddfd1efef13a508af6d749b.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_a84e093f5b5f93a4d816748cd93ca655.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_ed7deceeb4617fc3489fa659ff4ba24a.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_fa0155a500615b8f0f31b697d8afe0e5.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6fa63197b4c04960d958e215bcdfca32.jpg not downloaded yet
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_cbcb9f286742f574254c8f77ff38e5e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6b67e5c2d6b0b1c30ba333c3c06ce8b6.jpg not downloaded yet
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_30ba46e0281144ee8bda31e29c0b8cc3.jpg not downloaded yet
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5516c90>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_cbcb9f286742f574254c8f77ff38e5e2.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6fa63197b4c04960d958e215bcdfca32.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785b10>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6fa63197b4c04960d958e215bcdfca32.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_30ba46e0281144ee8bda31e29c0b8cc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bf910>
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_30ba46e0281144ee8bda31e29c0b8cc3.jpg saved to cache
2026-04-27 07:59:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6b67e5c2d6b0b1c30ba333c3c06ce8b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fbf90>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6b67e5c2d6b0b1c30ba333c3c06ce8b6.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_fa0155a500615b8f0f31b697d8afe0e5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5878750>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_fa0155a500615b8f0f31b697d8afe0e5.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_ed7deceeb4617fc3489fa659ff4ba24a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3610>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_ed7deceeb4617fc3489fa659ff4ba24a.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_a84e093f5b5f93a4d816748cd93ca655.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f9050>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_a84e093f5b5f93a4d816748cd93ca655.jpg saved to cache
2026-04-27 07:59:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_8c5272e14ddfd1efef13a508af6d749b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6cc0ad5599cce11ef2b3c775f1d29bca.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58782d0>
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_8c5272e14ddfd1efef13a508af6d749b.jpg saved to cache
2026-04-27 07:59:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_41b1941cbc1fdee6f2c76d059fe67d09.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5582b50>
2026-04-27 07:59:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6cc0ad5599cce11ef2b3c775f1d29bca.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_46baf8ec6de0337418ad6d0ae0ae9a99.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d2710>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_41b1941cbc1fdee6f2c76d059fe67d09.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659ea10>
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_46baf8ec6de0337418ad6d0ae0ae9a99.jpg saved to cache
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7797d812-f98c-5658-87f7-d5236eccc7bb
2026-04-27 07:59:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7797d812-f98c-5658-87f7-d5236eccc7bb, skipping ID generation
2026-04-27 07:59:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7797d812-f98c-5658-87f7-d5236eccc7bb with scrape type 1
2026-04-27 07:59:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7797d812-f98c-5658-87f7-d5236eccc7bb sending to next pipeline
2026-04-27 07:59:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7797d812-f98c-5658-87f7-d5236eccc7bb, identifier: DN43208
2026-04-27 07:59:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7797d812-f98c-5658-87f7-d5236eccc7bb with identifier: DN43208
2026-04-27 07:59:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7797d812-f98c-5658-87f7-d5236eccc7bb with identifier: DN43208
2026-04-27 07:59:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7797d812-f98c-5658-87f7-d5236eccc7bb with identifier: DN43208 to the API
2026-04-27 07:59:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_46baf8ec6de0337418ad6d0ae0ae9a99.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Como',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:02:12Z',
'fuel_type': 'petrol',
'id': '7797d812-f98c-5658-87f7-d5236eccc7bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.8082,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN43208',
'listing': 'auction',
'location': 'IT, Como',
'location_confidence': 'geocoded',
'longitude': 9.0832,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 86675,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57296,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_46baf8ec6de0337418ad6d0ae0ae9a99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_41b1941cbc1fdee6f2c76d059fe67d09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60269,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6cc0ad5599cce11ef2b3c775f1d29bca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_8c5272e14ddfd1efef13a508af6d749b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_a84e093f5b5f93a4d816748cd93ca655.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_ed7deceeb4617fc3489fa659ff4ba24a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_fa0155a500615b8f0f31b697d8afe0e5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6fa63197b4c04960d958e215bcdfca32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_6b67e5c2d6b0b1c30ba333c3c06ce8b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7797d812-f98c-5658-87f7-d5236eccc7bb/7797d812-f98c-5658-87f7-d5236eccc7bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56794,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfd/d3/fdd30ac7509cbe14d6fdce9fdf05d3fa/pa/DN43208_30ba46e0281144ee8bda31e29c0b8cc3.jpg',
'Width': 800}],
'postal_code': '22100',
'price': 0,
'price_includes_vat': True,
'province': 'Como',
'province_code': 'IT-CO',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2021-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.3 DIG-T Mild-Hybrid Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2021}
2026-04-27 07:59:17 [auto1.it] INFO: Saving data for DN43208: {'created_time': 1777276757.210284, 'last_price_update_time': 1777276757.210299, 'has_photos': True, 'auction_closing_time': 1777388532.0}
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_347accc8c86aa1f19bf9367995ffb45c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_6c0ad6735e1653eb26cc938c5904cada.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58668d0>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_347accc8c86aa1f19bf9367995ffb45c.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589f950>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_6c0ad6735e1653eb26cc938c5904cada.jpg saved to cache
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d
2026-04-27 07:59:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c80ae525-19ab-5bea-a59a-9791b4e8bd7d, skipping ID generation
2026-04-27 07:59:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d with scrape type 1
2026-04-27 07:59:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c80ae525-19ab-5bea-a59a-9791b4e8bd7d sending to next pipeline
2026-04-27 07:59:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c80ae525-19ab-5bea-a59a-9791b4e8bd7d, identifier: HZ27868
2026-04-27 07:59:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c80ae525-19ab-5bea-a59a-9791b4e8bd7d with identifier: HZ27868
2026-04-27 07:59:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c80ae525-19ab-5bea-a59a-9791b4e8bd7d with identifier: HZ27868
2026-04-27 07:59:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c80ae525-19ab-5bea-a59a-9791b4e8bd7d with identifier: HZ27868 to the API
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_6c0ad6735e1653eb26cc938c5904cada.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': 'Rental',
'city': 'Milazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:34:11Z',
'fuel_type': 'diesel',
'id': 'c80ae525-19ab-5bea-a59a-9791b4e8bd7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ27868',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Jeep',
'model': 'Renegade',
'odometer': 134289,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86615,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_6c0ad6735e1653eb26cc938c5904cada.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95039,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_cbcb9f286742f574254c8f77ff38e5e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_834afb2d71d541721a51c929573d9407.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_99448036f896842ae172b9beecf0b5d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_47818fc18b2449a2e718044c5883fa85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_76dd13e5f9a48e1a2007e6d526477dc4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_7b96880c3f1ae02024aa4c4d95c8e321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ebf1bed9221003f866615897bd1bed21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_aa5d8e8bf89979918b23a9954595a80b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c80ae525-19ab-5bea-a59a-9791b4e8bd7d/c80ae525-19ab-5bea-a59a-9791b4e8bd7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64446,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/00/3b000c3f749c0639f7efa27690a5e042/pa/HZ27868_ce59f19c1ab6f8ef89a9f30f588dc1bc.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2018-04-26',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Limited FWD',
'transmission': 'automatic',
'trim': 'Limited FWD',
'year': 2018}
2026-04-27 07:59:17 [auto1.it] INFO: Saving data for HZ27868: {'created_time': 1777276757.870485, 'last_price_update_time': 1777276757.870493, 'has_photos': True, 'auction_closing_time': 1777390451.0}
2026-04-27 07:59:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_dfa7a1a158821694270434d8bed91c39.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557c310>
2026-04-27 07:59:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_dfa7a1a158821694270434d8bed91c39.jpg saved to cache
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_aa876258f43a9f6141cdba0a24f7dbb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548c150>
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_aa876258f43a9f6141cdba0a24f7dbb4.jpg saved to cache
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VG85580> (referer: https://www.auto1.com/v1/car-details-view/VG85580/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e17ab45-49a7-54e1-944d-0f208ad27219 with identifier: VG85580
2026-04-27 07:59:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e17ab45-49a7-54e1-944d-0f208ad27219 with scrape type 1
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6d8f981c1c4cdcc80f43032f4e59049a.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d17837f0dc71aab5fe7605f4d6b4eff7.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_f5cd85ddc190af48909605d1a6b1ecb9.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_2dd951ff846a6b06d72d781b1699345f.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_0e719ebd25a8af65da9ff704dbae982a.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_aedca4dd0d6306d63c4a4823d8ecc49a.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6a2622dad620626e665e72480d4f659d.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d8ee60de6744dfbe55d55df8e7baa605.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_c6e3b12737b908689340d9cbcef7ebfe.jpg not downloaded yet
2026-04-27 07:59:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_69b60f0433eaab5027c79fa5daead3bc.jpg not downloaded yet
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LT53608> (referer: https://www.auto1.com/v1/car-details-view/LT53608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 860565f3-efd8-55de-b0aa-73edd80e3ff0 with identifier: LT53608
2026-04-27 07:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860565f3-efd8-55de-b0aa-73edd80e3ff0 with scrape type 1
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_b065abf3215a372052cc216456943ddd.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_53ced0526034a7ccb43957e42ef071e2.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_6973b83e972f8b92ad431e88f4f78b23.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_3457e1896730a948e153f3b6172ea30f.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d8e8fc52f9d8b797421bb5bc4f99af21.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_2c9f80ccbb5c154c1fede4028af7a6f2.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_820d44bfe80e497f7eb24a1391c28b90.jpg not downloaded yet
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_69b60f0433eaab5027c79fa5daead3bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_1c4d77f8255b4a22d65709bee483b370.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d0cf537759beb3c87aab5ad4b4a23bfa.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_fef38711d04f88d71ee88c676b17eef0.jpg not downloaded yet
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a51a50>
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_69b60f0433eaab5027c79fa5daead3bc.jpg saved to cache
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_820d44bfe80e497f7eb24a1391c28b90.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bfb10>
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_820d44bfe80e497f7eb24a1391c28b90.jpg saved to cache
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XX72461> (referer: https://www.auto1.com/v1/car-details-view/XX72461/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_fef38711d04f88d71ee88c676b17eef0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-04-27 07:59:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05f1fa7-636a-5d59-a26a-68568af1c1cd with scrape type 1
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_6b1d87d4ed7a3bd2be92f2552db53403.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_631864b4eaa5ce1c984e86a69b5eeeee.jpg not downloaded yet
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d0cf537759beb3c87aab5ad4b4a23bfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b9b7a2b8f2fa5307feda5977fe372a71.jpg not downloaded yet
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d1290>
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_fef38711d04f88d71ee88c676b17eef0.jpg saved to cache
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_1c4d77f8255b4a22d65709bee483b370.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b1dfbbe75db98970bd7db27160b98994.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_a94ab4bdfca0fdf3ae4cf9827b6325d3.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_af5f4599fa18a7a948c6ff65cfce31f5.jpg not downloaded yet
2026-04-27 07:59:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b10c8f36bb95d798d7a37220d07f9033.jpg not downloaded yet
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c24d0>
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d0cf537759beb3c87aab5ad4b4a23bfa.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_5064d12dc622595098f4a14f065f54b9.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c88fe18e89b6c073309016250e5cf293.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c7929a45b02862b7b4b83f6c37fa7697.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587dcd0>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_1c4d77f8255b4a22d65709bee483b370.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_631864b4eaa5ce1c984e86a69b5eeeee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FY15726> (referer: https://www.auto1.com/v1/car-details-view/FY15726/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b9b7a2b8f2fa5307feda5977fe372a71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b4850>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_631864b4eaa5ce1c984e86a69b5eeeee.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 586a33fa-3d9b-577e-b75d-d68b809ee46d with identifier: FY15726
2026-04-27 07:59:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586a33fa-3d9b-577e-b75d-d68b809ee46d with scrape type 1
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_94749a592dd04c000cebf683328b1f01.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ec50>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b9b7a2b8f2fa5307feda5977fe372a71.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2395f7c24b3d8ae3d5d01a64febcecef.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_0d2a618e7ef2c0b8281a34946b570045.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c7929a45b02862b7b4b83f6c37fa7697.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c88fe18e89b6c073309016250e5cf293.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_daa52fd4ff163b1e40f8cb8d2a5989f4.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_59c8852714dc95606e05a141ab21d944.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_a38e3d89347a5695220f1befddc59258.jpg not downloaded yet
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_5064d12dc622595098f4a14f065f54b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_e81110ac77356bb07a50ce48b2f11d76.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_ef49cefead3132c929cab34662442628.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_044dc7c489aeb2a36c630d1ba8a78711.jpg not downloaded yet
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2ab3b683b0344fa2c71d8912f4db31c6.jpg not downloaded yet
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c1090>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c7929a45b02862b7b4b83f6c37fa7697.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64899d0>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c88fe18e89b6c073309016250e5cf293.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58af410>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_5064d12dc622595098f4a14f065f54b9.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2395f7c24b3d8ae3d5d01a64febcecef.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_0d2a618e7ef2c0b8281a34946b570045.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_a38e3d89347a5695220f1befddc59258.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e1750>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2395f7c24b3d8ae3d5d01a64febcecef.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b3d90>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_0d2a618e7ef2c0b8281a34946b570045.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_044dc7c489aeb2a36c630d1ba8a78711.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0450>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_a38e3d89347a5695220f1befddc59258.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2ab3b683b0344fa2c71d8912f4db31c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_ef49cefead3132c929cab34662442628.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a53b90>
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_044dc7c489aeb2a36c630d1ba8a78711.jpg saved to cache
2026-04-27 07:59:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ92101> (referer: https://www.auto1.com/v1/car-details-view/MJ92101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953290>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2ab3b683b0344fa2c71d8912f4db31c6.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589cd10>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_ef49cefead3132c929cab34662442628.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_e81110ac77356bb07a50ce48b2f11d76.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_94749a592dd04c000cebf683328b1f01.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_daa52fd4ff163b1e40f8cb8d2a5989f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f765b422-5271-54f0-865b-23a128047085 with identifier: MJ92101
2026-04-27 07:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f765b422-5271-54f0-865b-23a128047085 with scrape type 1
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_db68a637e54e980650d741b2c4083292.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_223b16c30431ee431ff43e9394e5bbc5.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_59c8852714dc95606e05a141ab21d944.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_6c29a4ef790f0f6163235cd8f6de1007.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_232bd2a8e7e176a8d9c9d47bac37a035.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f7e64d8047a618ad34a31deecaeca037.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_d9f3c1b528c98ea82d381b21e3cd7c71.jpg not downloaded yet
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6488390>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_e81110ac77356bb07a50ce48b2f11d76.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587d310>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_94749a592dd04c000cebf683328b1f01.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5816e10>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_daa52fd4ff163b1e40f8cb8d2a5989f4.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f250f358b532d569a52f8d7c28704e9f.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_223b16c30431ee431ff43e9394e5bbc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b10c8f36bb95d798d7a37220d07f9033.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_a25cd84bd78aa504a4dcb6463248e147.jpg not downloaded yet
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU37885> (referer: https://www.auto1.com/v1/car-details-view/EU37885/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_a94ab4bdfca0fdf3ae4cf9827b6325d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55bd750>
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_59c8852714dc95606e05a141ab21d944.jpg saved to cache
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 586a33fa-3d9b-577e-b75d-d68b809ee46d
2026-04-27 07:59:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 586a33fa-3d9b-577e-b75d-d68b809ee46d, skipping ID generation
2026-04-27 07:59:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 586a33fa-3d9b-577e-b75d-d68b809ee46d with scrape type 1
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 586a33fa-3d9b-577e-b75d-d68b809ee46d sending to next pipeline
2026-04-27 07:59:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 586a33fa-3d9b-577e-b75d-d68b809ee46d, identifier: FY15726
2026-04-27 07:59:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_af5f4599fa18a7a948c6ff65cfce31f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_308ace8553ecd24ec7a2846b6d19dca0.jpg not downloaded yet
2026-04-27 07:59:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 586a33fa-3d9b-577e-b75d-d68b809ee46d with identifier: FY15726
2026-04-27 07:59:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 586a33fa-3d9b-577e-b75d-d68b809ee46d with identifier: FY15726
2026-04-27 07:59:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 586a33fa-3d9b-577e-b75d-d68b809ee46d with identifier: FY15726 to the API
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_59c8852714dc95606e05a141ab21d944.jpg>
{'auction_title': '',
'c_o_2_emission_value': 148,
'category': None,
'city': 'Reggio Emilia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:23:51Z',
'fuel_type': 'petrol',
'id': '586a33fa-3d9b-577e-b75d-d68b809ee46d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FY15726',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'MINI',
'model': 'Countryman',
'odometer': 56500,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_94749a592dd04c000cebf683328b1f01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62321,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2395f7c24b3d8ae3d5d01a64febcecef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_0d2a618e7ef2c0b8281a34946b570045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_daa52fd4ff163b1e40f8cb8d2a5989f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_59c8852714dc95606e05a141ab21d944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_a38e3d89347a5695220f1befddc59258.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_e81110ac77356bb07a50ce48b2f11d76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_ef49cefead3132c929cab34662442628.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_044dc7c489aeb2a36c630d1ba8a78711.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_586a33fa-3d9b-577e-b75d-d68b809ee46d/586a33fa-3d9b-577e-b75d-d68b809ee46d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56272,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge9/8f/e98f36667eab57a0e1ea2eae4b63ddb1/pa/FY15726_2ab3b683b0344fa2c71d8912f4db31c6.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2022-08-11',
'seats_number': 5,
'seller_name': None,
'title': 'MINI Countryman Cooper Classic Trim',
'transmission': 'automatic',
'trim': 'Classic Trim',
'year': 2022}
2026-04-27 07:59:23 [auto1.it] INFO: Saving data for FY15726: {'created_time': 1777276763.100595, 'last_price_update_time': 1777276763.100605, 'has_photos': True, 'auction_closing_time': 1777389831.0}
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_23c13899060bcf72b0c6abdc6582f262.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AG74645> (referer: https://www.auto1.com/v1/car-details-view/AG74645/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f250f358b532d569a52f8d7c28704e9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_d9f3c1b528c98ea82d381b21e3cd7c71.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EA93789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567f190>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_223b16c30431ee431ff43e9394e5bbc5.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0250>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b10c8f36bb95d798d7a37220d07f9033.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe76f577-dc91-55cf-b589-9c329a84067b with scrape type 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2a8d0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_a94ab4bdfca0fdf3ae4cf9827b6325d3.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2d490>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_af5f4599fa18a7a948c6ff65cfce31f5.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_232bd2a8e7e176a8d9c9d47bac37a035.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_a25cd84bd78aa504a4dcb6463248e147.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f7e64d8047a618ad34a31deecaeca037.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with identifier: AG74645
2026-04-27 07:59:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with scrape type 1
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_228e6fdc4cf3ae39211f3b0589ca42b4.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562bf10>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f250f358b532d569a52f8d7c28704e9f.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65917d0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_d9f3c1b528c98ea82d381b21e3cd7c71.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_23c13899060bcf72b0c6abdc6582f262.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_6c29a4ef790f0f6163235cd8f6de1007.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_db68a637e54e980650d741b2c4083292.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_308ace8553ecd24ec7a2846b6d19dca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_b104320f9d7a72b18f12c8fb6800dea3.jpg not downloaded yet
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b4750>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_232bd2a8e7e176a8d9c9d47bac37a035.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6387fd0>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_a25cd84bd78aa504a4dcb6463248e147.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5691250>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f7e64d8047a618ad34a31deecaeca037.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_8f15e5fec6a837aca2739c793cd28854.jpg not downloaded yet
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg not downloaded yet
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_6b1d87d4ed7a3bd2be92f2552db53403.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9b34cd4d8eb966b142dc809aaca275a1.jpg not downloaded yet
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ae110>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_23c13899060bcf72b0c6abdc6582f262.jpg saved to cache
2026-04-27 07:59:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6593190>
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_6c29a4ef790f0f6163235cd8f6de1007.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6328b90>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_db68a637e54e980650d741b2c4083292.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6591a90>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_308ace8553ecd24ec7a2846b6d19dca0.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f765b422-5271-54f0-865b-23a128047085
2026-04-27 07:59:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f765b422-5271-54f0-865b-23a128047085, skipping ID generation
2026-04-27 07:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f765b422-5271-54f0-865b-23a128047085 with scrape type 1
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f765b422-5271-54f0-865b-23a128047085 sending to next pipeline
2026-04-27 07:59:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f765b422-5271-54f0-865b-23a128047085, identifier: MJ92101
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b1dfbbe75db98970bd7db27160b98994.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f765b422-5271-54f0-865b-23a128047085 with identifier: MJ92101
2026-04-27 07:59:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f765b422-5271-54f0-865b-23a128047085 with identifier: MJ92101
2026-04-27 07:59:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f765b422-5271-54f0-865b-23a128047085 with identifier: MJ92101 to the API
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_308ace8553ecd24ec7a2846b6d19dca0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Palermo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:03:13Z',
'fuel_type': 'diesel',
'id': 'f765b422-5271-54f0-865b-23a128047085',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.1321,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ92101',
'listing': 'auction',
'location': 'IT, Palermo',
'location_confidence': 'geocoded',
'longitude': 13.3356,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 129319,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_db68a637e54e980650d741b2c4083292.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113070,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_223b16c30431ee431ff43e9394e5bbc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_6c29a4ef790f0f6163235cd8f6de1007.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_232bd2a8e7e176a8d9c9d47bac37a035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f7e64d8047a618ad34a31deecaeca037.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_d9f3c1b528c98ea82d381b21e3cd7c71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_f250f358b532d569a52f8d7c28704e9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_a25cd84bd78aa504a4dcb6463248e147.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_308ace8553ecd24ec7a2846b6d19dca0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f765b422-5271-54f0-865b-23a128047085/f765b422-5271-54f0-865b-23a128047085_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/07/82071dec295cace17a10d5681d25484d/pa/MJ92101_23c13899060bcf72b0c6abdc6582f262.jpg',
'Width': 800}],
'postal_code': '90100',
'price': 0,
'price_includes_vat': True,
'province': 'Palermo',
'province_code': 'IT-PA',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2016-04-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI GTD BlueMotion Tech',
'transmission': 'automatic',
'trim': 'GTD BlueMotion Tech',
'year': 2016}
2026-04-27 07:59:24 [auto1.it] INFO: Saving data for MJ92101: {'created_time': 1777276764.698595, 'last_price_update_time': 1777276764.698611, 'has_photos': True, 'auction_closing_time': 1777388593.0}
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_3e9cdc2bdd1458318115b71f32ca3845.jpg not downloaded yet
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fbc10>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65d9810>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_6b1d87d4ed7a3bd2be92f2552db53403.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_228e6fdc4cf3ae39211f3b0589ca42b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_334a549a602f5fe510ae4b00b170fb6a.jpg not downloaded yet
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ae110>
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b1dfbbe75db98970bd7db27160b98994.jpg saved to cache
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e05f1fa7-636a-5d59-a26a-68568af1c1cd
2026-04-27 07:59:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e05f1fa7-636a-5d59-a26a-68568af1c1cd, skipping ID generation
2026-04-27 07:59:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e05f1fa7-636a-5d59-a26a-68568af1c1cd with scrape type 1
2026-04-27 07:59:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e05f1fa7-636a-5d59-a26a-68568af1c1cd sending to next pipeline
2026-04-27 07:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e05f1fa7-636a-5d59-a26a-68568af1c1cd, identifier: XX72461
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HD20212> (referer: https://www.auto1.com/v1/car-details-view/HD20212/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-04-27 07:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461
2026-04-27 07:59:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e05f1fa7-636a-5d59-a26a-68568af1c1cd with identifier: XX72461 to the API
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b1dfbbe75db98970bd7db27160b98994.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:09:21Z',
'fuel_type': 'diesel',
'id': 'e05f1fa7-636a-5d59-a26a-68568af1c1cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XX72461',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 345462,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_6b1d87d4ed7a3bd2be92f2552db53403.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_631864b4eaa5ce1c984e86a69b5eeeee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88020,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b9b7a2b8f2fa5307feda5977fe372a71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b1dfbbe75db98970bd7db27160b98994.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_a94ab4bdfca0fdf3ae4cf9827b6325d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_af5f4599fa18a7a948c6ff65cfce31f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70541,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_b10c8f36bb95d798d7a37220d07f9033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_5064d12dc622595098f4a14f065f54b9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c88fe18e89b6c073309016250e5cf293.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e05f1fa7-636a-5d59-a26a-68568af1c1cd/e05f1fa7-636a-5d59-a26a-68568af1c1cd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92246,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/e9/02e95e916ad18349ae6d961b7e1763c6/pa/XX72461_c7929a45b02862b7b4b83f6c37fa7697.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-09-08',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Executive 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Executive 4Motion BlueMotion Tech',
'year': 2016}
2026-04-27 07:59:25 [auto1.it] INFO: Saving data for XX72461: {'created_time': 1777276765.389369, 'last_price_update_time': 1777276765.389381, 'has_photos': True, 'auction_closing_time': 1777388961.0}
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9a8f2d2dd79f2b8faa2563d58154eb8f.jpg not downloaded yet
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PM34750> (referer: https://www.auto1.com/v1/car-details-view/PM34750/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a79d0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_8f15e5fec6a837aca2739c793cd28854.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9b34cd4d8eb966b142dc809aaca275a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566c1d0>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ccd50>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_228e6fdc4cf3ae39211f3b0589ca42b4.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_0d08201e44b334dfd3baaaf72d350435.jpg not downloaded yet
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4b06210>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab394220-7d62-5f93-b7cc-c424796aaf86 with identifier: HD20212
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab394220-7d62-5f93-b7cc-c424796aaf86 with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_fba7d5d4d7fbdef238f1d2f49e59e11e.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_b104320f9d7a72b18f12c8fb6800dea3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_d81551ea36baba88024a176b561e5a48.jpg not downloaded yet
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_b85a7ad71e6e5335b76bb77eaaf217da.jpg not downloaded yet
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b9b10>
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg saved to cache
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fe76f577-dc91-55cf-b589-9c329a84067b
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fe76f577-dc91-55cf-b589-9c329a84067b, skipping ID generation
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe76f577-dc91-55cf-b589-9c329a84067b with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fe76f577-dc91-55cf-b589-9c329a84067b sending to next pipeline
2026-04-27 07:59:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fe76f577-dc91-55cf-b589-9c329a84067b, identifier: EU37885
2026-04-27 07:59:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fbda464-04f5-5525-9902-62ccb87c682f with identifier: PM34750
2026-04-27 07:59:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbda464-04f5-5525-9902-62ccb87c682f with scrape type 1
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_a063ead07d1e74f43cdf2e06998d9f7b.jpg not downloaded yet
2026-04-27 07:59:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_3e9cdc2bdd1458318115b71f32ca3845.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-04-27 07:59:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885
2026-04-27 07:59:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fe76f577-dc91-55cf-b589-9c329a84067b with identifier: EU37885 to the API
2026-04-27 07:59:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Milazzo',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 163,
'expiration_date': '2026-04-28T15:54:26Z',
'fuel_type': 'diesel',
'id': 'fe76f577-dc91-55cf-b589-9c329a84067b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU37885',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'BMW',
'model': '3er',
'odometer': 200869,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_ddcaac29c8239e399abf2f9f8bcbfd36.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_80c2d3ec6803db780577bc8a8c6a10d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_b3b8fc798a62f5b3920a90a9a95ed999.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_9147155cbe6a0914f8d7f111d60e0a69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fe76f577-dc91-55cf-b589-9c329a84067b/fe76f577-dc91-55cf-b589-9c329a84067b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/c6/c4c64e46ed0265c9717616f6f277181e/pa/EU37885_a8ec9bfde8b805b9650aaca78f837a80.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2006-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'manual',
'trim': '',
'year': 2006}
2026-04-27 07:59:26 [auto1.it] INFO: Saving data for EU37885: {'created_time': 1777276766.174566, 'last_price_update_time': 1777276766.174579, 'has_photos': True, 'auction_closing_time': 1777391666.0}
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead634b3d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_8f15e5fec6a837aca2739c793cd28854.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566e890>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9b34cd4d8eb966b142dc809aaca275a1.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_3457e1896730a948e153f3b6172ea30f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_6faa0cc1ab1f51ab8ff6d5430b545e6e.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_61e4c679f7ea79af446345098f2c56ae.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_2ef6184fda1d9056775d399e537fee4e.jpg not downloaded yet
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_2c9f80ccbb5c154c1fede4028af7a6f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d8e8fc52f9d8b797421bb5bc4f99af21.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_334a549a602f5fe510ae4b00b170fb6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_53ced0526034a7ccb43957e42ef071e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_6973b83e972f8b92ad431e88f4f78b23.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659a050>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_b104320f9d7a72b18f12c8fb6800dea3.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9a8f2d2dd79f2b8faa2563d58154eb8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_2335fd432a22078d125547424648c5b1.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_97bb3d5733f7335c568211afda384531.jpg not downloaded yet
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HC93680> (referer: https://www.auto1.com/v1/car-details-view/HC93680/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560e150>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_3e9cdc2bdd1458318115b71f32ca3845.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_fba7d5d4d7fbdef238f1d2f49e59e11e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_9cf565e2e027cea1f1f5eb5265314f65.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_4828e188f594353972ca2871c8136832.jpg not downloaded yet
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.748(s), this was the 1st time calling it.
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.569399229634368 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.572(s), this was the 1st time calling it.
2026-04-27 07:59:26 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.172266236441631 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c050>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_3457e1896730a948e153f3b6172ea30f.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57609d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_2c9f80ccbb5c154c1fede4028af7a6f2.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4fee810>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d8e8fc52f9d8b797421bb5bc4f99af21.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6379bd0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_334a549a602f5fe510ae4b00b170fb6a.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57637d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_53ced0526034a7ccb43957e42ef071e2.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ef2d0>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_6973b83e972f8b92ad431e88f4f78b23.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_1bfddfa629a7871b7192120143fe2fdb.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_174c9ad277075afa92fe394337fddf1f.jpg not downloaded yet
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_c6e3b12737b908689340d9cbcef7ebfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_a063ead07d1e74f43cdf2e06998d9f7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_b065abf3215a372052cc216456943ddd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_b85a7ad71e6e5335b76bb77eaaf217da.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6465d90>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9a8f2d2dd79f2b8faa2563d58154eb8f.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_d81551ea36baba88024a176b561e5a48.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_2ef6184fda1d9056775d399e537fee4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_0d08201e44b334dfd3baaaf72d350435.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_61e4c679f7ea79af446345098f2c56ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_af3cfcaee809545b806f328773886653.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_817a5d5ce991943fb00f673c6d04ceb8.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1050dfab-3148-5f44-bb69-57dfd678e2b7 with identifier: HC93680
2026-04-27 07:59:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1050dfab-3148-5f44-bb69-57dfd678e2b7 with scrape type 1
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_10502b512779f9ca7591aa527b99799f.jpg not downloaded yet
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567d210>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_fba7d5d4d7fbdef238f1d2f49e59e11e.jpg saved to cache
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_ee24cd3bb6b75101d81b54160feae96b.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_11b672fb6dd9b81e9a144400c62f02fc.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_f839c8577fee2397e38f3e3fe551dc68.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_5dd877b7f62bfe3ae6892e4eb42103be.jpg not downloaded yet
2026-04-27 07:59:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_e623ffb8251bbc89a1fd268dcef03bb3.jpg not downloaded yet
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763550>
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_c6e3b12737b908689340d9cbcef7ebfe.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696390>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_a063ead07d1e74f43cdf2e06998d9f7b.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e1c50>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_b065abf3215a372052cc216456943ddd.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 860565f3-efd8-55de-b0aa-73edd80e3ff0
2026-04-27 07:59:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 860565f3-efd8-55de-b0aa-73edd80e3ff0, skipping ID generation
2026-04-27 07:59:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 860565f3-efd8-55de-b0aa-73edd80e3ff0 with scrape type 1
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 860565f3-efd8-55de-b0aa-73edd80e3ff0 sending to next pipeline
2026-04-27 07:59:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 860565f3-efd8-55de-b0aa-73edd80e3ff0, identifier: LT53608
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53363d0>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_b85a7ad71e6e5335b76bb77eaaf217da.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_8d64e51ee0f2bc1b024946dbc181d150.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 860565f3-efd8-55de-b0aa-73edd80e3ff0 with identifier: LT53608
2026-04-27 07:59:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 860565f3-efd8-55de-b0aa-73edd80e3ff0 with identifier: LT53608
2026-04-27 07:59:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 860565f3-efd8-55de-b0aa-73edd80e3ff0 with identifier: LT53608 to the API
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_b065abf3215a372052cc216456943ddd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Capannori',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:22:13Z',
'fuel_type': 'diesel',
'id': '860565f3-efd8-55de-b0aa-73edd80e3ff0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT53608',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Mercedes-Benz',
'model': 'CLA-Klasse',
'odometer': 261743,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_b065abf3215a372052cc216456943ddd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_53ced0526034a7ccb43957e42ef071e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75004,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_6973b83e972f8b92ad431e88f4f78b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60997,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_3457e1896730a948e153f3b6172ea30f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d8e8fc52f9d8b797421bb5bc4f99af21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_2c9f80ccbb5c154c1fede4028af7a6f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_820d44bfe80e497f7eb24a1391c28b90.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76241,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_1c4d77f8255b4a22d65709bee483b370.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_d0cf537759beb3c87aab5ad4b4a23bfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_860565f3-efd8-55de-b0aa-73edd80e3ff0/860565f3-efd8-55de-b0aa-73edd80e3ff0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43505,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/63/3063320b350a76cc6d8ff52e9d9bdef6/pa/LT53608_fef38711d04f88d71ee88c676b17eef0.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2015-09-29',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz CLA-Klasse CLA 200 d Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2015}
2026-04-27 07:59:27 [auto1.it] INFO: Saving data for LT53608: {'created_time': 1777276767.788763, 'last_price_update_time': 1777276767.788771, 'has_photos': True, 'auction_closing_time': 1777389733.0}
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_97bb3d5733f7335c568211afda384531.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_4828e188f594353972ca2871c8136832.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d8ee60de6744dfbe55d55df8e7baa605.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_174c9ad277075afa92fe394337fddf1f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_e2650b31a6fe4ead21c57c4b655e3319.jpg not downloaded yet
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_6f2ed3700fd3c92d7bb5dd4c93d25d7e.jpg not downloaded yet
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_9cf565e2e027cea1f1f5eb5265314f65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_6faa0cc1ab1f51ab8ff6d5430b545e6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_2335fd432a22078d125547424648c5b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_1bfddfa629a7871b7192120143fe2fdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b929cea2741d60e9ee6aa8e4f0fd1ce.jpg not downloaded yet
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5411e90>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_d81551ea36baba88024a176b561e5a48.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ae590>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_2ef6184fda1d9056775d399e537fee4e.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6385810>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_0d08201e44b334dfd3baaaf72d350435.jpg saved to cache
2026-04-27 07:59:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593e390>
2026-04-27 07:59:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_61e4c679f7ea79af446345098f2c56ae.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_d665475c550aaadc424f026f40f41c00.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_9792850fe78a571664dfb6bf68a2c885.jpg not downloaded yet
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6598150>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_97bb3d5733f7335c568211afda384531.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6290>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_4828e188f594353972ca2871c8136832.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a2dd0>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d8ee60de6744dfbe55d55df8e7baa605.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f8a10>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_174c9ad277075afa92fe394337fddf1f.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567fc10>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_9cf565e2e027cea1f1f5eb5265314f65.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65d8f90>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_6faa0cc1ab1f51ab8ff6d5430b545e6e.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84
2026-04-27 07:59:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84, skipping ID generation
2026-04-27 07:59:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with scrape type 1
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 sending to next pipeline
2026-04-27 07:59:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84, identifier: AG74645
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721fe10>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_2335fd432a22078d125547424648c5b1.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57509d0>
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_1bfddfa629a7871b7192120143fe2fdb.jpg saved to cache
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_5dd877b7f62bfe3ae6892e4eb42103be.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6a2622dad620626e665e72480d4f659d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_8d64e51ee0f2bc1b024946dbc181d150.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_e623ffb8251bbc89a1fd268dcef03bb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_11b672fb6dd9b81e9a144400c62f02fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b2d359baa50a9827aebc55919e6180a.jpg not downloaded yet
2026-04-27 07:59:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with identifier: AG74645
2026-04-27 07:59:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with identifier: AG74645
2026-04-27 07:59:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bad36f1-46ea-5205-b9a0-f15dc8c3aa84 with identifier: AG74645 to the API
2026-04-27 07:59:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_6faa0cc1ab1f51ab8ff6d5430b545e6e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Cesena',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:31:39Z',
'fuel_type': 'gas',
'id': '2bad36f1-46ea-5205-b9a0-f15dc8c3aa84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.1391,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AG74645',
'listing': 'auction',
'location': 'IT, Cesena',
'location_confidence': 'geocoded',
'longitude': 12.2431,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 168216,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 133741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_228e6fdc4cf3ae39211f3b0589ca42b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_b104320f9d7a72b18f12c8fb6800dea3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_8f15e5fec6a837aca2739c793cd28854.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9b34cd4d8eb966b142dc809aaca275a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_3e9cdc2bdd1458318115b71f32ca3845.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_334a549a602f5fe510ae4b00b170fb6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_9a8f2d2dd79f2b8faa2563d58154eb8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_0d08201e44b334dfd3baaaf72d350435.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_d81551ea36baba88024a176b561e5a48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bad36f1-46ea-5205-b9a0-f15dc8c3aa84/2bad36f1-46ea-5205-b9a0-f15dc8c3aa84_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/fa/dafa27ae90032a7fcdf26506cf5941e1/pa/AG74645_6faa0cc1ab1f51ab8ff6d5430b545e6e.jpg',
'Width': 800}],
'postal_code': '47023',
'price': 0,
'price_includes_vat': True,
'province': 'Forli',
'province_code': 'IT-FC',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2008-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.4 LPG Laureate',
'transmission': 'manual',
'trim': 'Laureate',
'year': 2008}
2026-04-27 07:59:29 [auto1.it] INFO: Saving data for AG74645: {'created_time': 1777276769.258417, 'last_price_update_time': 1777276769.258433, 'has_photos': True, 'auction_closing_time': 1777390299.0}
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_ee24cd3bb6b75101d81b54160feae96b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_10502b512779f9ca7591aa527b99799f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_f839c8577fee2397e38f3e3fe551dc68.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.816(s), this was the 1st time calling it.
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.203113303555024 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.815(s), this was the 1st time calling it.
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.127716802337348 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4053aa413797da870b3340e0876bf35e.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EA93789> (referer: https://www.auto1.com/v1/car-details-view/EA93789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_22a45878749bcaf577f43e40217b44f7.jpg not downloaded yet
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6386e10>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_5dd877b7f62bfe3ae6892e4eb42103be.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659d390>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6a2622dad620626e665e72480d4f659d.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63282d0>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_8d64e51ee0f2bc1b024946dbc181d150.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659f690>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_e623ffb8251bbc89a1fd268dcef03bb3.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6690>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_11b672fb6dd9b81e9a144400c62f02fc.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b929cea2741d60e9ee6aa8e4f0fd1ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_d665475c550aaadc424f026f40f41c00.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_817a5d5ce991943fb00f673c6d04ceb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_9792850fe78a571664dfb6bf68a2c885.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_aedca4dd0d6306d63c4a4823d8ecc49a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_af3cfcaee809545b806f328773886653.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_6826d59fa18daab66732307b3416be9a.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_6f2ed3700fd3c92d7bb5dd4c93d25d7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_e2650b31a6fe4ead21c57c4b655e3319.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_0cd17f6e3708af51b6395686d8b5bbf1.jpg not downloaded yet
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f91d0>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_ee24cd3bb6b75101d81b54160feae96b.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560e650>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_10502b512779f9ca7591aa527b99799f.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55934d0>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_f839c8577fee2397e38f3e3fe551dc68.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfc87076-0f22-5317-830e-fbc3713d0ed3 with identifier: EA93789
2026-04-27 07:59:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc87076-0f22-5317-830e-fbc3713d0ed3 with scrape type 1
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6153f2c9214c07ddeab9911a8796d7af.jpg not downloaded yet
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6d8f981c1c4cdcc80f43032f4e59049a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d17837f0dc71aab5fe7605f4d6b4eff7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4053aa413797da870b3340e0876bf35e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_f5cd85ddc190af48909605d1a6b1ecb9.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_0e719ebd25a8af65da9ff704dbae982a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_2dd951ff846a6b06d72d781b1699345f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b2d359baa50a9827aebc55919e6180a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_862080ecf2169f7790fdb0ebd602a19f.jpg not downloaded yet
2026-04-27 07:59:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_22a45878749bcaf577f43e40217b44f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6acaa9c9fbca41440acfb45b3bb2a218.jpg not downloaded yet
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5942710>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b929cea2741d60e9ee6aa8e4f0fd1ce.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a73410>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_d665475c550aaadc424f026f40f41c00.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5411790>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_817a5d5ce991943fb00f673c6d04ceb8.jpg saved to cache
2026-04-27 07:59:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6337190>
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_9792850fe78a571664dfb6bf68a2c885.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5413f90>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_aedca4dd0d6306d63c4a4823d8ecc49a.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548dcd0>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_af3cfcaee809545b806f328773886653.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae540a790>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_6f2ed3700fd3c92d7bb5dd4c93d25d7e.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3fbda464-04f5-5525-9902-62ccb87c682f
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fbda464-04f5-5525-9902-62ccb87c682f, skipping ID generation
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fbda464-04f5-5525-9902-62ccb87c682f with scrape type 1
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fbda464-04f5-5525-9902-62ccb87c682f sending to next pipeline
2026-04-27 07:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3fbda464-04f5-5525-9902-62ccb87c682f, identifier: PM34750
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59becd0>
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_e2650b31a6fe4ead21c57c4b655e3319.jpg saved to cache
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab394220-7d62-5f93-b7cc-c424796aaf86
2026-04-27 07:59:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab394220-7d62-5f93-b7cc-c424796aaf86, skipping ID generation
2026-04-27 07:59:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab394220-7d62-5f93-b7cc-c424796aaf86 with scrape type 1
2026-04-27 07:59:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab394220-7d62-5f93-b7cc-c424796aaf86 sending to next pipeline
2026-04-27 07:59:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab394220-7d62-5f93-b7cc-c424796aaf86, identifier: HD20212
2026-04-27 07:59:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3fbda464-04f5-5525-9902-62ccb87c682f with identifier: PM34750
2026-04-27 07:59:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3fbda464-04f5-5525-9902-62ccb87c682f with identifier: PM34750
2026-04-27 07:59:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3fbda464-04f5-5525-9902-62ccb87c682f with identifier: PM34750 to the API
2026-04-27 07:59:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_6f2ed3700fd3c92d7bb5dd4c93d25d7e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:03:43Z',
'fuel_type': 'diesel',
'id': '3fbda464-04f5-5525-9902-62ccb87c682f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PM34750',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Skoda',
'model': 'Octavia',
'odometer': 166128,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_a063ead07d1e74f43cdf2e06998d9f7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_2ef6184fda1d9056775d399e537fee4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_97bb3d5733f7335c568211afda384531.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_4828e188f594353972ca2871c8136832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47298,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_174c9ad277075afa92fe394337fddf1f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63457,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_817a5d5ce991943fb00f673c6d04ceb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_11b672fb6dd9b81e9a144400c62f02fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_e623ffb8251bbc89a1fd268dcef03bb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69309,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_6f2ed3700fd3c92d7bb5dd4c93d25d7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3fbda464-04f5-5525-9902-62ccb87c682f/3fbda464-04f5-5525-9902-62ccb87c682f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/1d/981da7900d9dcc1a88040dd8df0bb916/pa/PM34750_d665475c550aaadc424f026f40f41c00.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2019-07-10',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 1.6 TDI Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2019}
2026-04-27 07:59:31 [auto1.it] INFO: Saving data for PM34750: {'created_time': 1777276771.571584, 'last_price_update_time': 1777276771.571595, 'has_photos': True, 'auction_closing_time': 1777388623.0}
2026-04-27 07:59:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab394220-7d62-5f93-b7cc-c424796aaf86 with identifier: HD20212
2026-04-27 07:59:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab394220-7d62-5f93-b7cc-c424796aaf86 with identifier: HD20212
2026-04-27 07:59:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab394220-7d62-5f93-b7cc-c424796aaf86 with identifier: HD20212 to the API
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_e2650b31a6fe4ead21c57c4b655e3319.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:21:53Z',
'fuel_type': 'diesel',
'id': 'ab394220-7d62-5f93-b7cc-c424796aaf86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HD20212',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Kia',
'model': 'Sportage',
'odometer': 85552,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_fba7d5d4d7fbdef238f1d2f49e59e11e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_b85a7ad71e6e5335b76bb77eaaf217da.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_61e4c679f7ea79af446345098f2c56ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70723,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_2335fd432a22078d125547424648c5b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_9cf565e2e027cea1f1f5eb5265314f65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_1bfddfa629a7871b7192120143fe2fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_af3cfcaee809545b806f328773886653.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_ee24cd3bb6b75101d81b54160feae96b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_5dd877b7f62bfe3ae6892e4eb42103be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab394220-7d62-5f93-b7cc-c424796aaf86/ab394220-7d62-5f93-b7cc-c424796aaf86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8f/15/8f156ba45bb5976027c166310b1f6cce/pa/HD20212_e2650b31a6fe4ead21c57c4b655e3319.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2018-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Business Class 2WD',
'transmission': 'manual',
'trim': 'Business Class 2WD',
'year': 2018}
2026-04-27 07:59:31 [auto1.it] INFO: Saving data for HD20212: {'created_time': 1777276771.945423, 'last_price_update_time': 1777276771.945436, 'has_photos': True, 'auction_closing_time': 1777389713.0}
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_0cd17f6e3708af51b6395686d8b5bbf1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_adba8cb3fff588b3b9414d6f4de35f06.jpg not downloaded yet
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6a5930a4871aeb873094a188e5c77a42.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6153f2c9214c07ddeab9911a8796d7af.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_6826d59fa18daab66732307b3416be9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_8965bc566cfee0ea713bb360600da386.jpg not downloaded yet
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636b490>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6d8f981c1c4cdcc80f43032f4e59049a.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5528c50>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d17837f0dc71aab5fe7605f4d6b4eff7.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636bc10>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4053aa413797da870b3340e0876bf35e.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b810>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_f5cd85ddc190af48909605d1a6b1ecb9.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c19d0>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_0e719ebd25a8af65da9ff704dbae982a.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5583010>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_2dd951ff846a6b06d72d781b1699345f.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e17ab45-49a7-54e1-944d-0f208ad27219
2026-04-27 07:59:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e17ab45-49a7-54e1-944d-0f208ad27219, skipping ID generation
2026-04-27 07:59:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e17ab45-49a7-54e1-944d-0f208ad27219 with scrape type 1
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e17ab45-49a7-54e1-944d-0f208ad27219 sending to next pipeline
2026-04-27 07:59:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1e17ab45-49a7-54e1-944d-0f208ad27219, identifier: VG85580
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557c610>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b2d359baa50a9827aebc55919e6180a.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c3dd0>
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_22a45878749bcaf577f43e40217b44f7.jpg saved to cache
2026-04-27 07:59:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1e17ab45-49a7-54e1-944d-0f208ad27219 with identifier: VG85580
2026-04-27 07:59:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1e17ab45-49a7-54e1-944d-0f208ad27219 with identifier: VG85580
2026-04-27 07:59:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1e17ab45-49a7-54e1-944d-0f208ad27219 with identifier: VG85580 to the API
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_2dd951ff846a6b06d72d781b1699345f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 211,
'expiration_date': '2026-04-28T15:26:35Z',
'fuel_type': 'diesel',
'id': '1e17ab45-49a7-54e1-944d-0f208ad27219',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VG85580',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Volvo',
'model': 'XC60',
'odometer': 102250,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 90,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6d8f981c1c4cdcc80f43032f4e59049a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d17837f0dc71aab5fe7605f4d6b4eff7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_f5cd85ddc190af48909605d1a6b1ecb9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_2dd951ff846a6b06d72d781b1699345f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_0e719ebd25a8af65da9ff704dbae982a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_aedca4dd0d6306d63c4a4823d8ecc49a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_6a2622dad620626e665e72480d4f659d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_d8ee60de6744dfbe55d55df8e7baa605.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63381,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_c6e3b12737b908689340d9cbcef7ebfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1e17ab45-49a7-54e1-944d-0f208ad27219/1e17ab45-49a7-54e1-944d-0f208ad27219_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/99/da9937c22a7fb45cfbb902ca44769409/pa/VG85580_69b60f0433eaab5027c79fa5daead3bc.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2020-09-16',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC60 2.0 B4 Diesel Inscription AWD',
'transmission': 'automatic',
'trim': 'Inscription AWD',
'year': 2020}
2026-04-27 07:59:32 [auto1.it] INFO: Saving data for VG85580: {'created_time': 1777276772.969199, 'last_price_update_time': 1777276772.96921, 'has_photos': True, 'auction_closing_time': 1777389995.0}
2026-04-27 07:59:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6acaa9c9fbca41440acfb45b3bb2a218.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b390>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_0cd17f6e3708af51b6395686d8b5bbf1.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547ee10>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6a5930a4871aeb873094a188e5c77a42.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be
2026-04-27 07:59:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be, skipping ID generation
2026-04-27 07:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with scrape type 1
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 91c50f63-6f2a-58ed-9a0f-9d31f24f62be sending to next pipeline
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be, identifier: CE85562
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589ff50>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6153f2c9214c07ddeab9911a8796d7af.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57500d0>
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_6826d59fa18daab66732307b3416be9a.jpg saved to cache
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1050dfab-3148-5f44-bb69-57dfd678e2b7
2026-04-27 07:59:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1050dfab-3148-5f44-bb69-57dfd678e2b7, skipping ID generation
2026-04-27 07:59:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1050dfab-3148-5f44-bb69-57dfd678e2b7 with scrape type 1
2026-04-27 07:59:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1050dfab-3148-5f44-bb69-57dfd678e2b7 sending to next pipeline
2026-04-27 07:59:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1050dfab-3148-5f44-bb69-57dfd678e2b7, identifier: HC93680
2026-04-27 07:59:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_862080ecf2169f7790fdb0ebd602a19f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with identifier: CE85562
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with identifier: CE85562
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 91c50f63-6f2a-58ed-9a0f-9d31f24f62be with identifier: CE85562 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6a5930a4871aeb873094a188e5c77a42.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Palermo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:37:23Z',
'fuel_type': 'petrol',
'id': '91c50f63-6f2a-58ed-9a0f-9d31f24f62be',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.1321,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE85562',
'listing': 'auction',
'location': 'IT, Palermo',
'location_confidence': 'geocoded',
'longitude': 13.3356,
'make': 'Peugeot',
'model': '207',
'odometer': 110821,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6a5930a4871aeb873094a188e5c77a42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_aa876258f43a9f6141cdba0a24f7dbb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_dfa7a1a158821694270434d8bed91c39.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74721,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_347accc8c86aa1f19bf9367995ffb45c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_19a2a3bf4443fa1e83435db693143899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_91c50f63-6f2a-58ed-9a0f-9d31f24f62be/91c50f63-6f2a-58ed-9a0f-9d31f24f62be_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/7e/1a7eac9e083ef518009f368572be36e0/pa/CE85562_6c917072a7664d2f6f3885566569646e.jpg',
'Width': 800}],
'postal_code': '90100',
'price': 0,
'price_includes_vat': True,
'province': 'Palermo',
'province_code': 'IT-PA',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2008-06-25',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 VTi Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-04-27 07:59:33 [auto1.it] INFO: Saving data for CE85562: {'created_time': 1777276773.794189, 'last_price_update_time': 1777276773.794203, 'has_photos': True, 'auction_closing_time': 1777390643.0}
2026-04-27 07:59:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1050dfab-3148-5f44-bb69-57dfd678e2b7 with identifier: HC93680
2026-04-27 07:59:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1050dfab-3148-5f44-bb69-57dfd678e2b7 with identifier: HC93680
2026-04-27 07:59:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1050dfab-3148-5f44-bb69-57dfd678e2b7 with identifier: HC93680 to the API
2026-04-27 07:59:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_6826d59fa18daab66732307b3416be9a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Roma',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 122,
'expiration_date': '2026-04-28T15:08:12Z',
'fuel_type': 'petrol',
'id': '1050dfab-3148-5f44-bb69-57dfd678e2b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC93680',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Audi',
'model': 'A1 Sportback',
'odometer': 215842,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67547,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_10502b512779f9ca7591aa527b99799f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_f839c8577fee2397e38f3e3fe551dc68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_8d64e51ee0f2bc1b024946dbc181d150.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b929cea2741d60e9ee6aa8e4f0fd1ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_9792850fe78a571664dfb6bf68a2c885.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4b2d359baa50a9827aebc55919e6180a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54062,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_4053aa413797da870b3340e0876bf35e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_22a45878749bcaf577f43e40217b44f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_6826d59fa18daab66732307b3416be9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1050dfab-3148-5f44-bb69-57dfd678e2b7/1050dfab-3148-5f44-bb69-57dfd678e2b7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/73/067378c62c184b61986d3ac4335dcb2c/pa/HC93680_0cd17f6e3708af51b6395686d8b5bbf1.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2014-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A1 Sportback 1.4 TFSI Attraction',
'transmission': 'automatic',
'trim': 'Attraction',
'year': 2014}
2026-04-27 07:59:34 [auto1.it] INFO: Saving data for HC93680: {'created_time': 1777276774.283922, 'last_price_update_time': 1777276774.283934, 'has_photos': True, 'auction_closing_time': 1777388892.0}
2026-04-27 07:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR34569/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e2290>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6acaa9c9fbca41440acfb45b3bb2a218.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WE55630/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552a510>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_862080ecf2169f7790fdb0ebd602a19f.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_8965bc566cfee0ea713bb360600da386.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_adba8cb3fff588b3b9414d6f4de35f06.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580d350>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_8965bc566cfee0ea713bb360600da386.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6363390>
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_adba8cb3fff588b3b9414d6f4de35f06.jpg saved to cache
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfc87076-0f22-5317-830e-fbc3713d0ed3
2026-04-27 07:59:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfc87076-0f22-5317-830e-fbc3713d0ed3, skipping ID generation
2026-04-27 07:59:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfc87076-0f22-5317-830e-fbc3713d0ed3 with scrape type 1
2026-04-27 07:59:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfc87076-0f22-5317-830e-fbc3713d0ed3 sending to next pipeline
2026-04-27 07:59:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cfc87076-0f22-5317-830e-fbc3713d0ed3, identifier: EA93789
2026-04-27 07:59:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ce4375b86eea5f939b6bf2eb02a1a3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cfc87076-0f22-5317-830e-fbc3713d0ed3 with identifier: EA93789
2026-04-27 07:59:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cfc87076-0f22-5317-830e-fbc3713d0ed3 with identifier: EA93789
2026-04-27 07:59:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cfc87076-0f22-5317-830e-fbc3713d0ed3 with identifier: EA93789 to the API
2026-04-27 07:59:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_adba8cb3fff588b3b9414d6f4de35f06.jpg>
{'auction_title': '',
'c_o_2_emission_value': 282,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 232,
'expiration_date': '2026-04-28T15:37:21Z',
'fuel_type': 'diesel',
'id': 'cfc87076-0f22-5317-830e-fbc3713d0ed3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EA93789',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Audi',
'model': 'Q7',
'odometer': 241754,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6153f2c9214c07ddeab9911a8796d7af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_862080ecf2169f7790fdb0ebd602a19f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85761,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_6acaa9c9fbca41440acfb45b3bb2a218.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_adba8cb3fff588b3b9414d6f4de35f06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cfc87076-0f22-5317-830e-fbc3713d0ed3/cfc87076-0f22-5317-830e-fbc3713d0ed3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66086,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/f7/14f71108e20d1994a6ad59fa007c41d0/pa/EA93789_8965bc566cfee0ea713bb360600da386.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2007-06-10',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q7 3.0 V6 TDI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2007}
2026-04-27 07:59:35 [auto1.it] INFO: Saving data for EA93789: {'created_time': 1777276775.141444, 'last_price_update_time': 1777276775.141455, 'has_photos': True, 'auction_closing_time': 1777390641.0}
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b08ddfcd43f628cbf9b2a8fa0b56f902.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a8ac10>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ce4375b86eea5f939b6bf2eb02a1a3b.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV81520/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566d250>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b08ddfcd43f628cbf9b2a8fa0b56f902.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ec86a44e24181672b944ea630cd97eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f83d0>
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ec86a44e24181672b944ea630cd97eb.jpg saved to cache
2026-04-27 07:59:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 07:59:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC04650/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP96260/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MS67358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE60733> (referer: https://www.auto1.com/v1/car-details-view/ZE60733/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with identifier: ZE60733
2026-04-27 07:59:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with scrape type 1
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d93ca53c29066053a309c73f15c55310.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_bc6efafccdd4267aa666fe381a59d300.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_49e4ffcf6b67b91a9f876d19902c6628.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7dc3ffee6fbde6e3e6f965d4731c8cc8.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_5483b2d24ca52f9afa2df07da844ad74.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7335c22dd78d16f5510394a0d1b2f031.jpg not downloaded yet
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_c892751084d30840c09f62b4cc0d8a02.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_e3c585472ca8fe260cb1d2cf812c2b7e.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_25815ebb30474096244d2eb38a51762b.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_494121431259e123d712717157686780.jpg not downloaded yet
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d8efe4a41ecbe766e3ef626197156bd5.jpg not downloaded yet
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f9450>
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_c892751084d30840c09f62b4cc0d8a02.jpg saved to cache
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7335c22dd78d16f5510394a0d1b2f031.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566e950>
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7335c22dd78d16f5510394a0d1b2f031.jpg saved to cache
2026-04-27 07:59:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d8efe4a41ecbe766e3ef626197156bd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f92d0>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d8efe4a41ecbe766e3ef626197156bd5.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_494121431259e123d712717157686780.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ac650>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_494121431259e123d712717157686780.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_25815ebb30474096244d2eb38a51762b.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WG36727> (referer: https://www.auto1.com/v1/car-details-view/WG36727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5528990>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_25815ebb30474096244d2eb38a51762b.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_e3c585472ca8fe260cb1d2cf812c2b7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with identifier: WG36727
2026-04-27 07:59:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with scrape type 1
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_c1f70c830c575a8ceec6bcae245fd3b7.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_f0c6ade4fb496a8d3ec0d57045b4f045.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_6f6743a3c6e64d8eb591a8c1920d50f7.jpg not downloaded yet
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_bd019ed64fa63237349650df453db455.jpg not downloaded yet
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK34576/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_80c5857c88f3e7241a4b1894b4c45b83.jpg not downloaded yet
2026-04-27 07:59:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548c810>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_e3c585472ca8fe260cb1d2cf812c2b7e.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_5483b2d24ca52f9afa2df07da844ad74.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7dc3ffee6fbde6e3e6f965d4731c8cc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_6f6743a3c6e64d8eb591a8c1920d50f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c3210>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_5483b2d24ca52f9afa2df07da844ad74.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a3c10>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7dc3ffee6fbde6e3e6f965d4731c8cc8.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_80c5857c88f3e7241a4b1894b4c45b83.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6328090>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_6f6743a3c6e64d8eb591a8c1920d50f7.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_bd019ed64fa63237349650df453db455.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ec950>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_80c5857c88f3e7241a4b1894b4c45b83.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_c1f70c830c575a8ceec6bcae245fd3b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c0a90>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_bd019ed64fa63237349650df453db455.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_f0c6ade4fb496a8d3ec0d57045b4f045.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a88950>
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_c1f70c830c575a8ceec6bcae245fd3b7.jpg saved to cache
2026-04-27 07:59:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_49e4ffcf6b67b91a9f876d19902c6628.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d93ca53c29066053a309c73f15c55310.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e0890>
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_f0c6ade4fb496a8d3ec0d57045b4f045.jpg saved to cache
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4
2026-04-27 07:59:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4, skipping ID generation
2026-04-27 07:59:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with scrape type 1
2026-04-27 07:59:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 sending to next pipeline
2026-04-27 07:59:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4, identifier: WG36727
2026-04-27 07:59:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with identifier: WG36727
2026-04-27 07:59:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with identifier: WG36727
2026-04-27 07:59:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 026aaf6c-4f63-5bd8-b8f7-32801a18bdf4 with identifier: WG36727 to the API
2026-04-27 07:59:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_f0c6ade4fb496a8d3ec0d57045b4f045.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:22:02Z',
'fuel_type': 'diesel',
'id': '026aaf6c-4f63-5bd8-b8f7-32801a18bdf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG36727',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 261658,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_c1f70c830c575a8ceec6bcae245fd3b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74549,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_f0c6ade4fb496a8d3ec0d57045b4f045.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_6f6743a3c6e64d8eb591a8c1920d50f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_bd019ed64fa63237349650df453db455.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_026aaf6c-4f63-5bd8-b8f7-32801a18bdf4/026aaf6c-4f63-5bd8-b8f7-32801a18bdf4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5d/ec/5decbe4828bb7c75bd8f0e1e4afac111/pa/WG36727_80c5857c88f3e7241a4b1894b4c45b83.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2012-09-24',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 TDI Trendline',
'transmission': 'manual',
'trim': 'Trendline',
'year': 2012}
2026-04-27 07:59:50 [auto1.it] INFO: Saving data for WG36727: {'created_time': 1777276790.673246, 'last_price_update_time': 1777276790.67326, 'has_photos': True, 'auction_closing_time': 1777389722.0}
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_bc6efafccdd4267aa666fe381a59d300.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FZ80944/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bd690>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_49e4ffcf6b67b91a9f876d19902c6628.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a99f50>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d93ca53c29066053a309c73f15c55310.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bf190>
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_bc6efafccdd4267aa666fe381a59d300.jpg saved to cache
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08
2026-04-27 07:59:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2eb05b75-4a09-5f03-a845-90d1d7eddf08, skipping ID generation
2026-04-27 07:59:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with scrape type 1
2026-04-27 07:59:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2eb05b75-4a09-5f03-a845-90d1d7eddf08 sending to next pipeline
2026-04-27 07:59:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2eb05b75-4a09-5f03-a845-90d1d7eddf08, identifier: ZE60733
2026-04-27 07:59:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with identifier: ZE60733
2026-04-27 07:59:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with identifier: ZE60733
2026-04-27 07:59:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2eb05b75-4a09-5f03-a845-90d1d7eddf08 with identifier: ZE60733 to the API
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_bc6efafccdd4267aa666fe381a59d300.jpg>
{'auction_title': '',
'c_o_2_emission_value': 93,
'category': None,
'city': 'Senago',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:52:04Z',
'fuel_type': 'petrol',
'id': '2eb05b75-4a09-5f03-a845-90d1d7eddf08',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE60733',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Opel',
'model': 'Corsa',
'odometer': 44082,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d93ca53c29066053a309c73f15c55310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_bc6efafccdd4267aa666fe381a59d300.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_49e4ffcf6b67b91a9f876d19902c6628.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48590,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7dc3ffee6fbde6e3e6f965d4731c8cc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_5483b2d24ca52f9afa2df07da844ad74.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_7335c22dd78d16f5510394a0d1b2f031.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_e3c585472ca8fe260cb1d2cf812c2b7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_25815ebb30474096244d2eb38a51762b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72416,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_494121431259e123d712717157686780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2eb05b75-4a09-5f03-a845-90d1d7eddf08/2eb05b75-4a09-5f03-a845-90d1d7eddf08_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/1d/9d1dc510914ccf9fb464bf3e04c2fe19/pa/ZE60733_d8efe4a41ecbe766e3ef626197156bd5.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2020-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 Elegance',
'transmission': 'manual',
'trim': 'Elegance',
'year': 2020}
2026-04-27 07:59:51 [auto1.it] INFO: Saving data for ZE60733: {'created_time': 1777276791.2547, 'last_price_update_time': 1777276791.25471, 'has_photos': True, 'auction_closing_time': 1777391524.0}
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_ff4d0f4daf55ed1d14c1f829cc59b2f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552ae10>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_ff4d0f4daf55ed1d14c1f829cc59b2f1.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_5da54c2b80e62d4ad01a802a39815e65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5334b90>
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_5da54c2b80e62d4ad01a802a39815e65.jpg saved to cache
2026-04-27 07:59:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DP83591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR34569> (referer: https://www.auto1.com/v1/car-details-view/TR34569/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with identifier: TR34569
2026-04-27 07:59:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with scrape type 1
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6730ade3611d73844be079e19e6d3a9f.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_7866fef26e8136a370780781bd6541a3.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DU34377/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e4b374c9a94a0f60a5e4ac8ea075102c.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_a649441086a671c1f6739159792cc05e.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_d6351f16ee5bc050a06525808d4db6e7.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_f37bea4425a8df94ed215226be133662.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6897a2215f91ec265de2407928e8946f.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6730ade3611d73844be079e19e6d3a9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e355afbd4e4dda09c22245c76b08ae0f.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_38a77b9e0a3a9a67a7c88232d10dc179.jpg not downloaded yet
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_1bc4a5dac3bd7c332bc0db009ecf7278.jpg not downloaded yet
2026-04-27 07:59:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_f37bea4425a8df94ed215226be133662.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b110>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6730ade3611d73844be079e19e6d3a9f.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5751610>
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_f37bea4425a8df94ed215226be133662.jpg saved to cache
2026-04-27 07:59:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FE93281/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV81520> (referer: https://www.auto1.com/v1/car-details-view/NV81520/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_38a77b9e0a3a9a67a7c88232d10dc179.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92151cd6-2af4-5619-a683-f72fc47639e2 with identifier: NV81520
2026-04-27 07:59:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92151cd6-2af4-5619-a683-f72fc47639e2 with scrape type 1
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_86671dfaad3b0e35355ebb7c0e4b45db.jpg not downloaded yet
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_1bc4a5dac3bd7c332bc0db009ecf7278.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_336de0d15d95a9e12c80de4784fbff65.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_b0f7dbb21a1710479b33c5eb6b9162cf.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_07a8199d77c89a5abf3fcfcff2339364.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5221e9a04b74bb2fea7e8415a68d55df.jpg not downloaded yet
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593edd0>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_38a77b9e0a3a9a67a7c88232d10dc179.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_fc7df215dd93c01e85939024dd8da750.jpg not downloaded yet
2026-04-27 07:59:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_86671dfaad3b0e35355ebb7c0e4b45db.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_e1b3580d6d339b67e9415c0af273804f.jpg not downloaded yet
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589cfd0>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_1bc4a5dac3bd7c332bc0db009ecf7278.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5479249e018718d25a760e17b2e2a8c5.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_f7e01b2869a89273bb5e220d49ee593a.jpg not downloaded yet
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_919e9888d663285101f4753bd3ea68ba.jpg not downloaded yet
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769e90>
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_86671dfaad3b0e35355ebb7c0e4b45db.jpg saved to cache
2026-04-27 07:59:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_fc7df215dd93c01e85939024dd8da750.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b950>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_fc7df215dd93c01e85939024dd8da750.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_919e9888d663285101f4753bd3ea68ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab1f50>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_919e9888d663285101f4753bd3ea68ba.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_f7e01b2869a89273bb5e220d49ee593a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4eb5110>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_f7e01b2869a89273bb5e220d49ee593a.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP96260> (referer: https://www.auto1.com/v1/car-details-view/PP96260/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5479249e018718d25a760e17b2e2a8c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC04650> (referer: https://www.auto1.com/v1/car-details-view/DC04650/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with identifier: PP96260
2026-04-27 07:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with scrape type 1
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_3b65011f217371ef69dbcb6762d8b9bd.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_0a5cb279fa199560d81a7b3648edb788.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_db262cb2758a6cba8289cefb85853ffa.jpg not downloaded yet
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab1450>
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5479249e018718d25a760e17b2e2a8c5.jpg saved to cache
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_69a8fe8b554094a23d5fba35db8d1e92.jpg not downloaded yet
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5221e9a04b74bb2fea7e8415a68d55df.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_a551047a355a17f041ad89c139acc39d.jpg not downloaded yet
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_07a8199d77c89a5abf3fcfcff2339364.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_e1b3580d6d339b67e9415c0af273804f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_6b5ebacf85b1964f482ff2e0d0d0cef6.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4c2e66-1549-5392-aea4-f5d25538b966 with identifier: DC04650
2026-04-27 07:59:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4c2e66-1549-5392-aea4-f5d25538b966 with scrape type 1
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_8b587bb5d17aca8683fed4fa6a184ebd.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1592f21766d1f10b2093203e1a5c7249.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_4a97996c789eee0333ffd612fe8b79e2.jpg not downloaded yet
2026-04-27 07:59:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c6b6243ac338e47c70f6432449f6676d.jpg not downloaded yet
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_21f32aac6f3ef98648cb223206627683.jpg not downloaded yet
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1eb1919237a3df1f133a66a8794e57ad.jpg not downloaded yet
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_02592b7e0173f2e9d4963aba899b055e.jpg not downloaded yet
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ec1d0>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5221e9a04b74bb2fea7e8415a68d55df.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c252a5f6e7402624276b74d3a4fa4f5c.jpg not downloaded yet
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_be0a21d07ce5ce6af2de6b1b964f762f.jpg not downloaded yet
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_a551047a355a17f041ad89c139acc39d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586fe10>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_07a8199d77c89a5abf3fcfcff2339364.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5339850>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_e1b3580d6d339b67e9415c0af273804f.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_69a8fe8b554094a23d5fba35db8d1e92.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_db262cb2758a6cba8289cefb85853ffa.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b0c50>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_a551047a355a17f041ad89c139acc39d.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_be0a21d07ce5ce6af2de6b1b964f762f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_02592b7e0173f2e9d4963aba899b055e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c5490>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_69a8fe8b554094a23d5fba35db8d1e92.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a74d0>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_db262cb2758a6cba8289cefb85853ffa.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c252a5f6e7402624276b74d3a4fa4f5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_21f32aac6f3ef98648cb223206627683.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580d6d0>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_be0a21d07ce5ce6af2de6b1b964f762f.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a3d0>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_02592b7e0173f2e9d4963aba899b055e.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1eb1919237a3df1f133a66a8794e57ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d2d90>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c252a5f6e7402624276b74d3a4fa4f5c.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575d890>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_21f32aac6f3ef98648cb223206627683.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c6b6243ac338e47c70f6432449f6676d.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580c950>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1eb1919237a3df1f133a66a8794e57ad.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_4a97996c789eee0333ffd612fe8b79e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_8b587bb5d17aca8683fed4fa6a184ebd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1592f21766d1f10b2093203e1a5c7249.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6475390>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c6b6243ac338e47c70f6432449f6676d.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5750210>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_4a97996c789eee0333ffd612fe8b79e2.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_3b65011f217371ef69dbcb6762d8b9bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575e650>
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_8b587bb5d17aca8683fed4fa6a184ebd.jpg saved to cache
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa4c2e66-1549-5392-aea4-f5d25538b966
2026-04-27 07:59:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa4c2e66-1549-5392-aea4-f5d25538b966, skipping ID generation
2026-04-27 07:59:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4c2e66-1549-5392-aea4-f5d25538b966 with scrape type 1
2026-04-27 07:59:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa4c2e66-1549-5392-aea4-f5d25538b966 sending to next pipeline
2026-04-27 07:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa4c2e66-1549-5392-aea4-f5d25538b966, identifier: DC04650
2026-04-27 07:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa4c2e66-1549-5392-aea4-f5d25538b966 with identifier: DC04650
2026-04-27 07:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa4c2e66-1549-5392-aea4-f5d25538b966 with identifier: DC04650
2026-04-27 07:59:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa4c2e66-1549-5392-aea4-f5d25538b966 with identifier: DC04650 to the API
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_8b587bb5d17aca8683fed4fa6a184ebd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'city': 'Ravenna',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:19:03Z',
'fuel_type': 'diesel',
'id': 'aa4c2e66-1549-5392-aea4-f5d25538b966',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.4134,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC04650',
'listing': 'auction',
'location': 'IT, Ravenna',
'location_confidence': 'geocoded',
'longitude': 12.2012,
'make': 'Citroen',
'model': 'DS4',
'odometer': 165494,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 114567,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_8b587bb5d17aca8683fed4fa6a184ebd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_4a97996c789eee0333ffd612fe8b79e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_21f32aac6f3ef98648cb223206627683.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_02592b7e0173f2e9d4963aba899b055e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa4c2e66-1549-5392-aea4-f5d25538b966/aa4c2e66-1549-5392-aea4-f5d25538b966_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img92/c4/92c49773d76bab71334ff687c06dc15c/pa/DC04650_be0a21d07ce5ce6af2de6b1b964f762f.jpg',
'Width': 800}],
'postal_code': '48100',
'price': 0,
'price_includes_vat': True,
'province': 'Ravenna',
'province_code': 'IT-RA',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2011-11-30',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS4 1.6 HDi SoChic',
'transmission': 'automatic',
'trim': 'SoChic',
'year': 2011}
2026-04-27 07:59:56 [auto1.it] INFO: Saving data for DC04650: {'created_time': 1777276796.551192, 'last_price_update_time': 1777276796.551206, 'has_photos': True, 'auction_closing_time': 1777389543.0}
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_0a5cb279fa199560d81a7b3648edb788.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_6b5ebacf85b1964f482ff2e0d0d0cef6.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_b0f7dbb21a1710479b33c5eb6b9162cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a4e50>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1592f21766d1f10b2093203e1a5c7249.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5529f90>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_3b65011f217371ef69dbcb6762d8b9bd.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6475ad0>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_0a5cb279fa199560d81a7b3648edb788.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e355afbd4e4dda09c22245c76b08ae0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5751590>
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_6b5ebacf85b1964f482ff2e0d0d0cef6.jpg saved to cache
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50
2026-04-27 07:59:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6ed57dc-8bd9-5884-bf80-19399f7f9f50, skipping ID generation
2026-04-27 07:59:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with scrape type 1
2026-04-27 07:59:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6ed57dc-8bd9-5884-bf80-19399f7f9f50 sending to next pipeline
2026-04-27 07:59:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a6ed57dc-8bd9-5884-bf80-19399f7f9f50, identifier: PP96260
2026-04-27 07:59:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with identifier: PP96260
2026-04-27 07:59:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with identifier: PP96260
2026-04-27 07:59:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a6ed57dc-8bd9-5884-bf80-19399f7f9f50 with identifier: PP96260 to the API
2026-04-27 07:59:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_6b5ebacf85b1964f482ff2e0d0d0cef6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:24:21Z',
'fuel_type': 'diesel',
'id': 'a6ed57dc-8bd9-5884-bf80-19399f7f9f50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP96260',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 119294,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_3b65011f217371ef69dbcb6762d8b9bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_0a5cb279fa199560d81a7b3648edb788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67966,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_db262cb2758a6cba8289cefb85853ffa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63345,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_69a8fe8b554094a23d5fba35db8d1e92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61133,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_a551047a355a17f041ad89c139acc39d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_6b5ebacf85b1964f482ff2e0d0d0cef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1592f21766d1f10b2093203e1a5c7249.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c6b6243ac338e47c70f6432449f6676d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_1eb1919237a3df1f133a66a8794e57ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a6ed57dc-8bd9-5884-bf80-19399f7f9f50/a6ed57dc-8bd9-5884-bf80-19399f7f9f50_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58497,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2e/81/2e8147abf16f923df917392aff3bd646/pa/PP96260_c252a5f6e7402624276b74d3a4fa4f5c.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2017-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport 2.0 Td4 SE AWD',
'transmission': 'automatic',
'trim': 'SE AWD',
'year': 2017}
2026-04-27 07:59:57 [auto1.it] INFO: Saving data for PP96260: {'created_time': 1777276797.163478, 'last_price_update_time': 1777276797.16349, 'has_photos': True, 'auction_closing_time': 1777389861.0}
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6897a2215f91ec265de2407928e8946f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5990>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_b0f7dbb21a1710479b33c5eb6b9162cf.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547f450>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_7.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e355afbd4e4dda09c22245c76b08ae0f.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_336de0d15d95a9e12c80de4784fbff65.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596a850>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_6.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6897a2215f91ec265de2407928e8946f.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_d6351f16ee5bc050a06525808d4db6e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_a649441086a671c1f6739159792cc05e.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f5550>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_336de0d15d95a9e12c80de4784fbff65.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92151cd6-2af4-5619-a683-f72fc47639e2
2026-04-27 07:59:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92151cd6-2af4-5619-a683-f72fc47639e2, skipping ID generation
2026-04-27 07:59:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92151cd6-2af4-5619-a683-f72fc47639e2 with scrape type 1
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92151cd6-2af4-5619-a683-f72fc47639e2 sending to next pipeline
2026-04-27 07:59:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92151cd6-2af4-5619-a683-f72fc47639e2, identifier: NV81520
2026-04-27 07:59:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92151cd6-2af4-5619-a683-f72fc47639e2 with identifier: NV81520
2026-04-27 07:59:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92151cd6-2af4-5619-a683-f72fc47639e2 with identifier: NV81520
2026-04-27 07:59:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92151cd6-2af4-5619-a683-f72fc47639e2 with identifier: NV81520 to the API
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_336de0d15d95a9e12c80de4784fbff65.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'category': None,
'city': 'Manoppello',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:32:42Z',
'fuel_type': 'diesel',
'id': '92151cd6-2af4-5619-a683-f72fc47639e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 42.2592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV81520',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'location_confidence': 'geocoded',
'longitude': 14.0602,
'make': 'Audi',
'model': 'A3 Sportback',
'odometer': 202926,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_86671dfaad3b0e35355ebb7c0e4b45db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69568,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_336de0d15d95a9e12c80de4784fbff65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_b0f7dbb21a1710479b33c5eb6b9162cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_07a8199d77c89a5abf3fcfcff2339364.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72231,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5221e9a04b74bb2fea7e8415a68d55df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_fc7df215dd93c01e85939024dd8da750.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_e1b3580d6d339b67e9415c0af273804f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70766,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_5479249e018718d25a760e17b2e2a8c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_f7e01b2869a89273bb5e220d49ee593a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92151cd6-2af4-5619-a683-f72fc47639e2/92151cd6-2af4-5619-a683-f72fc47639e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge1/75/e175a7298fdc3aa2811c6043727c3c5d/pa/NV81520_919e9888d663285101f4753bd3ea68ba.jpg',
'Width': 800}],
'postal_code': '65024',
'price': 0,
'price_includes_vat': True,
'province': 'Pescara',
'province_code': 'IT-PE',
'region': 'Abruzzi',
'region_code': 'IT-01',
'registration_date': '2013-06-11',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 Sportback 2.0 TDI S line Sportpaket',
'transmission': 'manual',
'trim': 'S line Sportpaket',
'year': 2013}
2026-04-27 07:59:57 [auto1.it] INFO: Saving data for NV81520: {'created_time': 1777276797.884038, 'last_price_update_time': 1777276797.884048, 'has_photos': True, 'auction_closing_time': 1777390362.0}
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_7866fef26e8136a370780781bd6541a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e4b374c9a94a0f60a5e4ac8ea075102c.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b7e1255abdbc184b3c2a657eece7afdf.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MS67358> (referer: https://www.auto1.com/v1/car-details-view/MS67358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65989d0>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_d6351f16ee5bc050a06525808d4db6e7.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566dbd0>
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_a649441086a671c1f6739159792cc05e.jpg saved to cache
2026-04-27 07:59:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f1cf67ace0d5a1e3baa2ee2175754461.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596a1d0>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_7866fef26e8136a370780781bd6541a3.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5334950>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e4b374c9a94a0f60a5e4ac8ea075102c.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655
2026-04-27 07:59:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655, skipping ID generation
2026-04-27 07:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with scrape type 1
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 sending to next pipeline
2026-04-27 07:59:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655, identifier: TR34569
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f28ae538cd1ddf99f1539a2ccb3abe9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with identifier: TR34569
2026-04-27 07:59:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with identifier: TR34569
2026-04-27 07:59:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 65ddb1ae-b198-5a4a-b1d3-362cc92fb655 with identifier: TR34569 to the API
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e4b374c9a94a0f60a5e4ac8ea075102c.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Padova',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 218,
'expiration_date': '2026-04-28T15:24:35Z',
'fuel_type': 'diesel',
'id': '65ddb1ae-b198-5a4a-b1d3-362cc92fb655',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR34569',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'BMW',
'model': 'X5',
'odometer': 139131,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66573,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6730ade3611d73844be079e19e6d3a9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54208,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_7866fef26e8136a370780781bd6541a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e4b374c9a94a0f60a5e4ac8ea075102c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_a649441086a671c1f6739159792cc05e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_d6351f16ee5bc050a06525808d4db6e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71744,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_f37bea4425a8df94ed215226be133662.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_6897a2215f91ec265de2407928e8946f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_e355afbd4e4dda09c22245c76b08ae0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65085,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_38a77b9e0a3a9a67a7c88232d10dc179.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_65ddb1ae-b198-5a4a-b1d3-362cc92fb655/65ddb1ae-b198-5a4a-b1d3-362cc92fb655_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img52/31/52313b699fa205e478f11e2bbcfe7db5/pa/TR34569_1bc4a5dac3bd7c332bc0db009ecf7278.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2006-04-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 3.0d',
'transmission': 'automatic',
'trim': '',
'year': 2006}
2026-04-27 07:59:58 [auto1.it] INFO: Saving data for TR34569: {'created_time': 1777276798.647434, 'last_price_update_time': 1777276798.647444, 'has_photos': True, 'auction_closing_time': 1777389875.0}
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5753010>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b7e1255abdbc184b3c2a657eece7afdf.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with identifier: MS67358
2026-04-27 07:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with scrape type 1
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_57268f075fc5c8ea4aa782a48ae907c1.jpg not downloaded yet
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f9265e02483ed86be5d6efcbfa0a0b89.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_87cd50f87f240be3461c7c388c4d0035.jpg not downloaded yet
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ade50>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_1.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f1cf67ace0d5a1e3baa2ee2175754461.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5865750>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f28ae538cd1ddf99f1539a2ccb3abe9f.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_8122cf285b6411117a527124abb4a646.jpg not downloaded yet
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_591839937f83d68f28743f464c2bed88.jpg not downloaded yet
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e470ce90ff54aa2fc8e1b142d7c99cd7.jpg not downloaded yet
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a27010>
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_2.jpg HTTP/1.1" 201 0
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f9265e02483ed86be5d6efcbfa0a0b89.jpg saved to cache
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822
2026-04-27 07:59:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822, skipping ID generation
2026-04-27 07:59:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with scrape type 1
2026-04-27 07:59:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 sending to next pipeline
2026-04-27 07:59:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822, identifier: BK72599
2026-04-27 07:59:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_57268f075fc5c8ea4aa782a48ae907c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_de0388e8d0f2ad7b99e468ce87ee2d72.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-04-27 07:59:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599
2026-04-27 07:59:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 07:59:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4e8eb3e1-82dc-58d2-b9b6-e49299cd6822 with identifier: BK72599 to the API
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 07:59:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f9265e02483ed86be5d6efcbfa0a0b89.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': 'Capannori',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:59:25Z',
'fuel_type': 'diesel',
'id': '4e8eb3e1-82dc-58d2-b9b6-e49299cd6822',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BK72599',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Renault',
'model': 'Captur',
'odometer': 199764,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70726,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f28ae538cd1ddf99f1539a2ccb3abe9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f1cf67ace0d5a1e3baa2ee2175754461.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_f9265e02483ed86be5d6efcbfa0a0b89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b7e1255abdbc184b3c2a657eece7afdf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60888,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_5da54c2b80e62d4ad01a802a39815e65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61916,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_ff4d0f4daf55ed1d14c1f829cc59b2f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_c892751084d30840c09f62b4cc0d8a02.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65506,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ec86a44e24181672b944ea630cd97eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65360,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_b08ddfcd43f628cbf9b2a8fa0b56f902.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4e8eb3e1-82dc-58d2-b9b6-e49299cd6822/4e8eb3e1-82dc-58d2-b9b6-e49299cd6822_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img97/fb/97fbd20f01d5c7b9f6127c0e37cdf860/pa/BK72599_7ce4375b86eea5f939b6bf2eb02a1a3b.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Wave',
'transmission': 'manual',
'trim': 'Wave',
'year': 2014}
2026-04-27 07:59:59 [auto1.it] INFO: Saving data for BK72599: {'created_time': 1777276799.326745, 'last_price_update_time': 1777276799.326756, 'has_photos': True, 'auction_closing_time': 1777391965.0}
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_ca90590463d368d0651406f45b6bca1a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_24b7787ecb397586ea8cfd53ba830b14.jpg not downloaded yet
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AN07953/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 07:59:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f9e90>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_57268f075fc5c8ea4aa782a48ae907c1.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_6f9dfa704bacac5d5b4c20ffc529d36a.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e028ca4f22f796efe5a56452a82ef6ee.jpg not downloaded yet
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_17308ea2de6124b8e294fec2b4fffb33.jpg not downloaded yet
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4eb7710>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_ca90590463d368d0651406f45b6bca1a.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e470ce90ff54aa2fc8e1b142d7c99cd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_de0388e8d0f2ad7b99e468ce87ee2d72.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_591839937f83d68f28743f464c2bed88.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a98950>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e470ce90ff54aa2fc8e1b142d7c99cd7.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bde50>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_de0388e8d0f2ad7b99e468ce87ee2d72.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5750d90>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_591839937f83d68f28743f464c2bed88.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_17308ea2de6124b8e294fec2b4fffb33.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e028ca4f22f796efe5a56452a82ef6ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5751590>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_17308ea2de6124b8e294fec2b4fffb33.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_6f9dfa704bacac5d5b4c20ffc529d36a.jpg> (referer: https://www.auto1.com/)
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad990>
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 07:59:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 07:59:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e028ca4f22f796efe5a56452a82ef6ee.jpg saved to cache
2026-04-27 07:59:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 07:59:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_24b7787ecb397586ea8cfd53ba830b14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636a910>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_6f9dfa704bacac5d5b4c20ffc529d36a.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_8122cf285b6411117a527124abb4a646.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_87cd50f87f240be3461c7c388c4d0035.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6360f50>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_24b7787ecb397586ea8cfd53ba830b14.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636a710>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_8122cf285b6411117a527124abb4a646.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575ddd0>
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_87cd50f87f240be3461c7c388c4d0035.jpg saved to cache
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e
2026-04-27 08:00:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e, skipping ID generation
2026-04-27 08:00:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with scrape type 1
2026-04-27 08:00:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e35edde4-fbd4-5fd2-b6da-d7583d2bff0e sending to next pipeline
2026-04-27 08:00:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e, identifier: MS67358
2026-04-27 08:00:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with identifier: MS67358
2026-04-27 08:00:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with identifier: MS67358
2026-04-27 08:00:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e35edde4-fbd4-5fd2-b6da-d7583d2bff0e with identifier: MS67358 to the API
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_87cd50f87f240be3461c7c388c4d0035.jpg>
{'auction_title': '',
'c_o_2_emission_value': 242,
'category': None,
'city': 'Padova',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.8L',
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:09:12Z',
'fuel_type': 'diesel',
'id': 'e35edde4-fbd4-5fd2-b6da-d7583d2bff0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MS67358',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Dodge',
'model': 'Nitro',
'odometer': 156908,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64171,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_57268f075fc5c8ea4aa782a48ae907c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_87cd50f87f240be3461c7c388c4d0035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_8122cf285b6411117a527124abb4a646.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_591839937f83d68f28743f464c2bed88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e470ce90ff54aa2fc8e1b142d7c99cd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53183,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_de0388e8d0f2ad7b99e468ce87ee2d72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_24b7787ecb397586ea8cfd53ba830b14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_6f9dfa704bacac5d5b4c20ffc529d36a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58858,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_e028ca4f22f796efe5a56452a82ef6ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e35edde4-fbd4-5fd2-b6da-d7583d2bff0e/e35edde4-fbd4-5fd2-b6da-d7583d2bff0e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga1/cc/a1cc916514f3a53d84bb5ebef6655156/pa/MS67358_17308ea2de6124b8e294fec2b4fffb33.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2010-03-24',
'seats_number': 5,
'seller_name': None,
'title': 'Dodge Nitro 2.8 CRD SXT',
'transmission': 'automatic',
'trim': 'SXT',
'year': 2010}
2026-04-27 08:00:00 [auto1.it] INFO: Saving data for MS67358: {'created_time': 1777276800.873714, 'last_price_update_time': 1777276800.873725, 'has_photos': True, 'auction_closing_time': 1777388952.0}
2026-04-27 08:00:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE39118/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZK34576> (referer: https://www.auto1.com/v1/car-details-view/ZK34576/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FZ80944> (referer: https://www.auto1.com/v1/car-details-view/FZ80944/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0f9a187-e50a-5c80-9034-b9905fa89e9b with identifier: ZK34576
2026-04-27 08:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f9a187-e50a-5c80-9034-b9905fa89e9b with scrape type 1
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_beb6f91764e5a85e20ba023d61845be0.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_ace8d9e132db0e06294ec4e11b129835.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_21b4cca0d2c3aecccf5ce893d02d06c9.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with identifier: FZ80944
2026-04-27 08:00:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with scrape type 1
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b68041385c6bd2deb6b3eafef8bb7b95.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b26555f31bde3479e5600bb8f349e9f8.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_4a0bf190875decedf85e5378dbb3036d.jpg not downloaded yet
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_1da53ea7e1a370a4e03839a260e2fd42.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b183b63539572c2fba85f9f60778bc12.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b48d248b201543dc7369fd019f29a935.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_f13697f550bd18045dc0cf934b560725.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_c4e6a9c680bf5228cf42ca178c6b97ec.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_5fa2c3422c699ef8078a92b5b9237046.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_d0eba232cc71fdf6ad39e5e09004c6c8.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_01883e7a3db1af4c8e63505d5fafc145.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_6f5a1417852a5a1d74af14b33153b0fe.jpg not downloaded yet
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_4a0bf190875decedf85e5378dbb3036d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_85fbd0441d10a8caf9c17f5974d11bed.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_997ea332113277e7400fb155494368a8.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_81ba2b6c74fbcfa1432c655db30f6ad2.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_50093a1c38d55d2082e05ee035688b44.jpg not downloaded yet
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0cb50>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_1da53ea7e1a370a4e03839a260e2fd42.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_00daae728a562ed6a560290f370604a0.jpg not downloaded yet
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_710ab1f52602c3e706af60513cc6c8b4.jpg not downloaded yet
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550c250>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_4a0bf190875decedf85e5378dbb3036d.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_01883e7a3db1af4c8e63505d5fafc145.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83cc850>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_01883e7a3db1af4c8e63505d5fafc145.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_710ab1f52602c3e706af60513cc6c8b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_00daae728a562ed6a560290f370604a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6363290>
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_710ab1f52602c3e706af60513cc6c8b4.jpg saved to cache
2026-04-27 08:00:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_50093a1c38d55d2082e05ee035688b44.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589ff50>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_00daae728a562ed6a560290f370604a0.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5339750>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_50093a1c38d55d2082e05ee035688b44.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_81ba2b6c74fbcfa1432c655db30f6ad2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5866c10>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_81ba2b6c74fbcfa1432c655db30f6ad2.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_997ea332113277e7400fb155494368a8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5865590>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_997ea332113277e7400fb155494368a8.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_85fbd0441d10a8caf9c17f5974d11bed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64b0f50>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_85fbd0441d10a8caf9c17f5974d11bed.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_6f5a1417852a5a1d74af14b33153b0fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7410>
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_6f5a1417852a5a1d74af14b33153b0fe.jpg saved to cache
2026-04-27 08:00:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_d0eba232cc71fdf6ad39e5e09004c6c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_5fa2c3422c699ef8078a92b5b9237046.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c4850>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_d0eba232cc71fdf6ad39e5e09004c6c8.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_c4e6a9c680bf5228cf42ca178c6b97ec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FE93281> (referer: https://www.auto1.com/v1/car-details-view/FE93281/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d4e10>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_5fa2c3422c699ef8078a92b5b9237046.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_f13697f550bd18045dc0cf934b560725.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575c5d0>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_c4e6a9c680bf5228cf42ca178c6b97ec.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93815607-a9c6-5f2d-82aa-f637aec3fd86 with identifier: FE93281
2026-04-27 08:00:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93815607-a9c6-5f2d-82aa-f637aec3fd86 with scrape type 1
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_02f106fa395381ca3f13f5a3eb46ee10.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_b36efb1f562bf00882be226aa35b83ff.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_a3322b82265b3269bbff5f71c85b3e0e.jpg not downloaded yet
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_0f9f229968e7630cb685c7267f6b7b6b.jpg not downloaded yet
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63556d0>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_f13697f550bd18045dc0cf934b560725.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_7e06427cdc6ab5115ff7fe6e87f2e17d.jpg not downloaded yet
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b48d248b201543dc7369fd019f29a935.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b183b63539572c2fba85f9f60778bc12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_0f9f229968e7630cb685c7267f6b7b6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953210>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b48d248b201543dc7369fd019f29a935.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550e2d0>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b183b63539572c2fba85f9f60778bc12.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab08d0>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_0f9f229968e7630cb685c7267f6b7b6b.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_7e06427cdc6ab5115ff7fe6e87f2e17d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_a3322b82265b3269bbff5f71c85b3e0e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_b36efb1f562bf00882be226aa35b83ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_02f106fa395381ca3f13f5a3eb46ee10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566f210>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_7e06427cdc6ab5115ff7fe6e87f2e17d.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b68041385c6bd2deb6b3eafef8bb7b95.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589d510>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_a3322b82265b3269bbff5f71c85b3e0e.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0fd90>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_b36efb1f562bf00882be226aa35b83ff.jpg saved to cache
2026-04-27 08:00:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25690>
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_02f106fa395381ca3f13f5a3eb46ee10.jpg saved to cache
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93815607-a9c6-5f2d-82aa-f637aec3fd86
2026-04-27 08:00:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93815607-a9c6-5f2d-82aa-f637aec3fd86, skipping ID generation
2026-04-27 08:00:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 93815607-a9c6-5f2d-82aa-f637aec3fd86 with scrape type 1
2026-04-27 08:00:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93815607-a9c6-5f2d-82aa-f637aec3fd86 sending to next pipeline
2026-04-27 08:00:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 93815607-a9c6-5f2d-82aa-f637aec3fd86, identifier: FE93281
2026-04-27 08:00:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 93815607-a9c6-5f2d-82aa-f637aec3fd86 with identifier: FE93281
2026-04-27 08:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 93815607-a9c6-5f2d-82aa-f637aec3fd86 with identifier: FE93281
2026-04-27 08:00:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 93815607-a9c6-5f2d-82aa-f637aec3fd86 with identifier: FE93281 to the API
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_02f106fa395381ca3f13f5a3eb46ee10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 162,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:50:20Z',
'fuel_type': 'petrol',
'id': '93815607-a9c6-5f2d-82aa-f637aec3fd86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE93281',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 185244,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77555,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_02f106fa395381ca3f13f5a3eb46ee10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66657,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_b36efb1f562bf00882be226aa35b83ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_a3322b82265b3269bbff5f71c85b3e0e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57265,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_0f9f229968e7630cb685c7267f6b7b6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_93815607-a9c6-5f2d-82aa-f637aec3fd86/93815607-a9c6-5f2d-82aa-f637aec3fd86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62592,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img4a/f0/4af09121f5612b2bd4bf9650a3c2abb2/pa/FE93281_7e06427cdc6ab5115ff7fe6e87f2e17d.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2008-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.6 Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2008}
2026-04-27 08:00:05 [auto1.it] INFO: Saving data for FE93281: {'created_time': 1777276805.989728, 'last_price_update_time': 1777276805.989738, 'has_photos': True, 'auction_closing_time': 1777391420.0}
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b26555f31bde3479e5600bb8f349e9f8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_21b4cca0d2c3aecccf5ce893d02d06c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DU34377> (referer: https://www.auto1.com/v1/car-details-view/DU34377/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WE55630> (referer: https://www.auto1.com/v1/car-details-view/WE55630/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DP83591> (referer: https://www.auto1.com/v1/car-details-view/DP83591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550d210>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b68041385c6bd2deb6b3eafef8bb7b95.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb9b46cb-91ad-527a-a8c7-a613a6b67f49, skipping ID generation
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb9b46cb-91ad-527a-a8c7-a613a6b67f49 sending to next pipeline
2026-04-27 08:00:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bb9b46cb-91ad-527a-a8c7-a613a6b67f49, identifier: FZ80944
2026-04-27 08:00:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with identifier: FZ80944
2026-04-27 08:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with identifier: FZ80944
2026-04-27 08:00:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb9b46cb-91ad-527a-a8c7-a613a6b67f49 with identifier: FZ80944 to the API
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b68041385c6bd2deb6b3eafef8bb7b95.jpg>
{'auction_title': '',
'c_o_2_emission_value': 159,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:10:43Z',
'fuel_type': 'diesel',
'id': 'bb9b46cb-91ad-527a-a8c7-a613a6b67f49',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FZ80944',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 163478,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88315,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b68041385c6bd2deb6b3eafef8bb7b95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85035,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_4a0bf190875decedf85e5378dbb3036d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88850,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_b48d248b201543dc7369fd019f29a935.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_c4e6a9c680bf5228cf42ca178c6b97ec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89535,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_d0eba232cc71fdf6ad39e5e09004c6c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_6f5a1417852a5a1d74af14b33153b0fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_997ea332113277e7400fb155494368a8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_50093a1c38d55d2082e05ee035688b44.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_00daae728a562ed6a560290f370604a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb9b46cb-91ad-527a-a8c7-a613a6b67f49/bb9b46cb-91ad-527a-a8c7-a613a6b67f49_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga2/d4/a2d44a31bdb71f1d988bfe8463fc14b1/pa/FZ80944_710ab1f52602c3e706af60513cc6c8b4.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2014-11-19',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI R-Line 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'R-Line 4Motion BlueMotion Tech',
'year': 2014}
2026-04-27 08:00:06 [auto1.it] INFO: Saving data for FZ80944: {'created_time': 1777276806.563103, 'last_price_update_time': 1777276806.563116, 'has_photos': True, 'auction_closing_time': 1777389043.0}
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_ace8d9e132db0e06294ec4e11b129835.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c4310>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b26555f31bde3479e5600bb8f349e9f8.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b2b10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_21b4cca0d2c3aecccf5ce893d02d06c9.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 200375bf-4134-55bb-af6f-34f20e37f617 with identifier: DU34377
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 200375bf-4134-55bb-af6f-34f20e37f617 with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 200375bf-4134-55bb-af6f-34f20e37f617
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_66e7c3ee7ca01559925cda88270b4b35.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 972f0ada-2b3e-566b-990f-87d4465e5f7e with identifier: WE55630
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 972f0ada-2b3e-566b-990f-87d4465e5f7e with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_db442fc035c4f96174f19113f7db2335.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with identifier: DP83591
2026-04-27 08:00:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13 with scrape type 1
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_10663238e04f060d7b1950509f3bf19e.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_beb6f91764e5a85e20ba023d61845be0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_46e215e7d4ccd509df1dc1649476dc9e.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_e1ef76e6565b8b50ba8c1fdb5d3d9e61.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5454d10>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_ace8d9e132db0e06294ec4e11b129835.jpg saved to cache
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_43a9a8551bb3d2357462dba8802a5a7b.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_273dbff58fa5d7fb67612c0d5d2be7e5.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_06cf020020a9d09f6d2ffadff4163fce.jpg not downloaded yet
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_cc05c630b6ba1a3d000bb25bffff9e7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_18c6b238e1e2b16c15a16ca264dd2924.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_f1423f4bd3dcdfa46646c985e5e4bf1a.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_96e92066aeb5e9ec6a2953b0ab1a6aa5.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_45966111bfec8d1eea4853e5f50e2eff.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/aa/56aac87e4b30e025683a95487f93fe20/pa/DU34377_e92f11ddfd8ea6cb76cbaaea8a70203d.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_546e27b32785341cd703d901a330d252.jpg not downloaded yet
2026-04-27 08:00:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg not downloaded yet
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae592b090>
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_beb6f91764e5a85e20ba023d61845be0.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f0f9a187-e50a-5c80-9034-b9905fa89e9b
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f0f9a187-e50a-5c80-9034-b9905fa89e9b, skipping ID generation
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0f9a187-e50a-5c80-9034-b9905fa89e9b with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f0f9a187-e50a-5c80-9034-b9905fa89e9b sending to next pipeline
2026-04-27 08:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f0f9a187-e50a-5c80-9034-b9905fa89e9b, identifier: ZK34576
2026-04-27 08:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f0f9a187-e50a-5c80-9034-b9905fa89e9b with identifier: ZK34576
2026-04-27 08:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f0f9a187-e50a-5c80-9034-b9905fa89e9b with identifier: ZK34576
2026-04-27 08:00:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f0f9a187-e50a-5c80-9034-b9905fa89e9b with identifier: ZK34576 to the API
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_beb6f91764e5a85e20ba023d61845be0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 95,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:58:25Z',
'fuel_type': 'diesel',
'id': 'f0f9a187-e50a-5c80-9034-b9905fa89e9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK34576',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Renault',
'model': 'Captur',
'odometer': 147251,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_beb6f91764e5a85e20ba023d61845be0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_ace8d9e132db0e06294ec4e11b129835.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_21b4cca0d2c3aecccf5ce893d02d06c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b26555f31bde3479e5600bb8f349e9f8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_b183b63539572c2fba85f9f60778bc12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90878,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_f13697f550bd18045dc0cf934b560725.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_5fa2c3422c699ef8078a92b5b9237046.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_01883e7a3db1af4c8e63505d5fafc145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_85fbd0441d10a8caf9c17f5974d11bed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f0f9a187-e50a-5c80-9034-b9905fa89e9b/f0f9a187-e50a-5c80-9034-b9905fa89e9b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd3/03/d3030fff5e2a11ee8cc881ce5804f0a7/pa/ZK34576_81ba2b6c74fbcfa1432c655db30f6ad2.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2017-03-13',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Captur 1.5 dCi Energy Zen',
'transmission': 'manual',
'trim': 'Zen',
'year': 2017}
2026-04-27 08:00:07 [auto1.it] INFO: Saving data for ZK34576: {'created_time': 1777276807.502836, 'last_price_update_time': 1777276807.502846, 'has_photos': True, 'auction_closing_time': 1777391905.0}
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_aac2368a974d0a69f9e6ae3cc07e3b24.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_e1ef76e6565b8b50ba8c1fdb5d3d9e61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_2af5f5f233ad8906bbc64cce9945a85a.jpg not downloaded yet
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg not downloaded yet
2026-04-27 08:00:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF83172/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a5cd0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3982b770-4266-551b-94ba-ae8149929f8e/3982b770-4266-551b-94ba-ae8149929f8e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge0/09/e009fc8070a3fe64b3c6b42d08b4997b/pa/YA50042_cc05c630b6ba1a3d000bb25bffff9e7b.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3982b770-4266-551b-94ba-ae8149929f8e
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d97d0>
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_18c6b238e1e2b16c15a16ca264dd2924.jpg saved to cache
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 126dc117-0180-57b3-9abb-cb76bf798535
2026-04-27 08:00:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 126dc117-0180-57b3-9abb-cb76bf798535, skipping ID generation
2026-04-27 08:00:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 126dc117-0180-57b3-9abb-cb76bf798535 with scrape type 1
2026-04-27 08:00:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 126dc117-0180-57b3-9abb-cb76bf798535 sending to next pipeline
2026-04-27 08:00:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 126dc117-0180-57b3-9abb-cb76bf798535, identifier: LC21140
2026-04-27 08:00:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 126dc117-0180-57b3-9abb-cb76bf798535 with identifier: LC21140
2026-04-27 08:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 126dc117-0180-57b3-9abb-cb76bf798535 with identifier: LC21140
2026-04-27 08:00:07 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 126dc117-0180-57b3-9abb-cb76bf798535 with identifier: LC21140 to the API
2026-04-27 08:00:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_18c6b238e1e2b16c15a16ca264dd2924.jpg>
{'auction_title': '',
'c_o_2_emission_value': 226,
'category': None,
'city': None,
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.5L',
'engine_horse_power': 400,
'expiration_date': '2026-04-28T15:00:34Z',
'fuel_type': 'petrol',
'id': '126dc117-0180-57b3-9abb-cb76bf798535',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC21140',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Audi',
'model': 'RS Q3 Sportback',
'odometer': 124388,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_18c6b238e1e2b16c15a16ca264dd2924.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 124839,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_d1bd03f528bceb9f30a75c44605a0c2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125197,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c8dc7ec068ca9cfe959c76f8ec8fb612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_1da53ea7e1a370a4e03839a260e2fd42.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113908,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_ca90590463d368d0651406f45b6bca1a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 126211,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_a35f9586ed4b1b6341148f6d8946fda4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_c2d46dd4eb53e251cd814efd0956db2a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 127679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_877d45f3de67c0a923bc8b9fc002d286.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_efbcd13d2de6dc65941abe1f80312189.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_126dc117-0180-57b3-9abb-cb76bf798535/126dc117-0180-57b3-9abb-cb76bf798535_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92774,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd0/16/d0160a3fe0c3ec325a167cc0784312ad/pa/LC21140_6d74a0ff83facb1522af75d9b322a869.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2023-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi RS Q3 Sportback 2.5 TFSI quattro',
'transmission': 'automatic',
'trim': 'quattro',
'year': 2023}
2026-04-27 08:00:08 [auto1.it] INFO: Saving data for LC21140: {'created_time': 1777276808.171466, 'last_price_update_time': 1777276808.171476, 'has_photos': True, 'auction_closing_time': 1777388434.0}
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_9fb2c0ee62ec8920960ebdcecb56bdc2.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg not downloaded yet
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54ad890>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_e722776fdaf231a6e5342a0e3657a3dd.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6489cd0>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_e1ef76e6565b8b50ba8c1fdb5d3d9e61.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_546e27b32785341cd703d901a330d252.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_4e0e21a6ab9836d90fcde517f3573691.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg not downloaded yet
2026-04-27 08:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YW47316/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_3b83d1607279071ca3a4296027f05c0c.jpg not downloaded yet
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg not downloaded yet
2026-04-27 08:00:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0f490>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_9de22cda0dde6884344d4456c3dd4786.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:08 [auto1.it] INFO: Channel: 24h | Page: 7 | totalHits: 3110 | hits on page: 40
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: UW55745
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562b090>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_35b09938bdf45b826a4b2006d5cd3178.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5695c10>
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_546e27b32785341cd703d901a330d252.jpg saved to cache
2026-04-27 08:00:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_9fb2c0ee62ec8920960ebdcecb56bdc2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: PM34750
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for PM34750: 0
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: CE85562
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for CE85562: 0
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: SX71536
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for SX71536: 0
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: MN63848
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for MN63848: 0
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: BD18129
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for BD18129: 1
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: NK94790
2026-04-27 08:00:08 [auto1.it] INFO: Scrape type for NK94790: 1
2026-04-27 08:00:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_2af5f5f233ad8906bbc64cce9945a85a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:08 [auto1.it] INFO: Found listing with ID: GM28799
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for GM28799: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: CV11446
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for CV11446: 1
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4ec8a10>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_9fb2c0ee62ec8920960ebdcecb56bdc2.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636b410>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_da4bd491f7837a19eccc0dcd0a12196a.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: GB46284
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for GB46284: 1
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab3c90>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_6d662dafbd270050d30eace27c25fdf8.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c94d0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_a27b38619e5dde67cfeb87ab586d9590.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548d7d0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_2af5f5f233ad8906bbc64cce9945a85a.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: EU61805
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for EU61805: 1
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_4e0e21a6ab9836d90fcde517f3573691.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_3b83d1607279071ca3a4296027f05c0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: AU36225
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for AU36225: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: EC41125
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for EC41125: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: NF75023
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for NF75023: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: LH68995
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for LH68995: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: YC78141
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for YC78141: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: ES64600
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for ES64600: 1
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55cb790>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aac817f7-1eea-52ef-b4b4-fbc55a13ff13/aac817f7-1eea-52ef-b4b4-fbc55a13ff13_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3d/e2/3de26a10d154e74c844bddd192bb47ea/pa/DP83591_52fdcc31c36485aed6a8c133382c3217.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aac817f7-1eea-52ef-b4b4-fbc55a13ff13
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: TF39801
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for TF39801: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: HZ95408
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for HZ95408: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: KD87590
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for KD87590: 1
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6411fd0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_4e0e21a6ab9836d90fcde517f3573691.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548ffd0>
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_972f0ada-2b3e-566b-990f-87d4465e5f7e/972f0ada-2b3e-566b-990f-87d4465e5f7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img97/62/97625711c75e281f57ffcc95618c8e24/pa/WE55630_3b83d1607279071ca3a4296027f05c0c.jpg saved to cache
2026-04-27 08:00:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 972f0ada-2b3e-566b-990f-87d4465e5f7e
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: TR00137
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for TR00137: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: FH21751
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for FH21751: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: CV66158
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for CV66158: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: SG75657
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for SG75657: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: GL11319
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for GL11319: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: JA34507
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for JA34507: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: MA72760
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for MA72760: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: TJ16144
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for TJ16144: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: SD72417
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for SD72417: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: EZ15465
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for EZ15465: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: RC90942
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for RC90942: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: YT13161
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for YT13161: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: DA21297
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for DA21297: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: RF33119
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for RF33119: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: VZ92626
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for VZ92626: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: BT13926
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for BT13926: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: SK61077
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for SK61077: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: JT08977
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for JT08977: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: HN50903
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for HN50903: 1
2026-04-27 08:00:09 [auto1.it] INFO: Found listing with ID: GY98380
2026-04-27 08:00:09 [auto1.it] INFO: Scrape type for GY98380: 1
2026-04-27 08:00:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST62394> (referer: https://www.auto1.com/v1/car-details-view/ST62394/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with identifier: ST62394
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2d4ecf578f942fb370b5d7bef14b3feb.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_9c9daaaebb1501b5482ee9aa67442f4b.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c0b6a3b8db11b1b5e393f5d90afa1d3d.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c8362c7b07ec48ca7cea3d3b7b20581f.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2f15bd33fdecd24896e115a53cc91556.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.extensions.logstats] INFO: Crawled 379 pages (at 43 pages/min), scraped 154 items (at 26 items/min)
2026-04-27 08:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_db6452acef3e79dda17a3389969f2c91.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA79833/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2bf84344961af92d4e18e9816e1a6dd6.jpg not downloaded yet
2026-04-27 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_955ab5a138af7576bba5e3b83d8e6687.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AN07953> (referer: https://www.auto1.com/v1/car-details-view/AN07953/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c4b6d79d412eadee2aeddb48ae7ce33d.jpg not downloaded yet
2026-04-27 08:00:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_8f41c5bc4226cd6e0d71512ac644c4bd.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89cf365b-28b7-52f6-9a6c-f67d33590caa with identifier: AN07953
2026-04-27 08:00:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cf365b-28b7-52f6-9a6c-f67d33590caa with scrape type 1
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_195215a8d7dcb9e82f6acaed56942b77.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_c13dc3fec66a3ffe4e217c8e2566cecc.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b2079293448e1ad00e85ae470a58c806.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f1f85d533bd4e1bb5843ef032ced34c3.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f7b5fd35c5cb973c5b4652634343e596.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_955ab5a138af7576bba5e3b83d8e6687.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b61fe9c8ef0ff4a0955bd64231230a19.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_17fd75c39da234265e29ce71c0be4663.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_e75ed8b3cb154358ed494892b9db266e.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b9e8b9df76584f72f56aac458d2224cc.jpg not downloaded yet
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_8b995b177dea5fd4cbdf568c2043c115.jpg not downloaded yet
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_db6452acef3e79dda17a3389969f2c91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57867d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_955ab5a138af7576bba5e3b83d8e6687.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9abd0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_db6452acef3e79dda17a3389969f2c91.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f7b5fd35c5cb973c5b4652634343e596.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_8b995b177dea5fd4cbdf568c2043c115.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55146d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f7b5fd35c5cb973c5b4652634343e596.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead575fe90>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_8b995b177dea5fd4cbdf568c2043c115.jpg saved to cache
2026-04-27 08:00:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_e75ed8b3cb154358ed494892b9db266e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b9e8b9df76584f72f56aac458d2224cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead641d4d0>
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_e75ed8b3cb154358ed494892b9db266e.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593fd90>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b9e8b9df76584f72f56aac458d2224cc.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b61fe9c8ef0ff4a0955bd64231230a19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW92714/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_17fd75c39da234265e29ce71c0be4663.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b1bd0>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b61fe9c8ef0ff4a0955bd64231230a19.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5490650>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_17fd75c39da234265e29ce71c0be4663.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f1f85d533bd4e1bb5843ef032ced34c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_c13dc3fec66a3ffe4e217c8e2566cecc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b2079293448e1ad00e85ae470a58c806.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_195215a8d7dcb9e82f6acaed56942b77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548d010>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f1f85d533bd4e1bb5843ef032ced34c3.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56eeed0>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_c13dc3fec66a3ffe4e217c8e2566cecc.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6354550>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b2079293448e1ad00e85ae470a58c806.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943290>
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_195215a8d7dcb9e82f6acaed56942b77.jpg saved to cache
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89cf365b-28b7-52f6-9a6c-f67d33590caa
2026-04-27 08:00:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89cf365b-28b7-52f6-9a6c-f67d33590caa, skipping ID generation
2026-04-27 08:00:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89cf365b-28b7-52f6-9a6c-f67d33590caa with scrape type 1
2026-04-27 08:00:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89cf365b-28b7-52f6-9a6c-f67d33590caa sending to next pipeline
2026-04-27 08:00:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 89cf365b-28b7-52f6-9a6c-f67d33590caa, identifier: AN07953
2026-04-27 08:00:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 89cf365b-28b7-52f6-9a6c-f67d33590caa with identifier: AN07953
2026-04-27 08:00:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 89cf365b-28b7-52f6-9a6c-f67d33590caa with identifier: AN07953
2026-04-27 08:00:12 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 89cf365b-28b7-52f6-9a6c-f67d33590caa with identifier: AN07953 to the API
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_195215a8d7dcb9e82f6acaed56942b77.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Milano',
'color': 'violet',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.2L',
'engine_horse_power': 82,
'expiration_date': '2026-04-28T15:04:28Z',
'fuel_type': 'petrol',
'id': '89cf365b-28b7-52f6-9a6c-f67d33590caa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN07953',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Citroen',
'model': 'C3',
'odometer': 105294,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_195215a8d7dcb9e82f6acaed56942b77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_c13dc3fec66a3ffe4e217c8e2566cecc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b2079293448e1ad00e85ae470a58c806.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f1f85d533bd4e1bb5843ef032ced34c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_f7b5fd35c5cb973c5b4652634343e596.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b61fe9c8ef0ff4a0955bd64231230a19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_17fd75c39da234265e29ce71c0be4663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65790,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_e75ed8b3cb154358ed494892b9db266e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59426,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_b9e8b9df76584f72f56aac458d2224cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_89cf365b-28b7-52f6-9a6c-f67d33590caa/89cf365b-28b7-52f6-9a6c-f67d33590caa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50229,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/c3/14c32f48de98c3e639230f533588b7fe/pa/AN07953_8b995b177dea5fd4cbdf568c2043c115.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 e-VTi Exclusive',
'transmission': 'manual',
'trim': 'Exclusive',
'year': 2015}
2026-04-27 08:00:12 [auto1.it] INFO: Saving data for AN07953: {'created_time': 1777276812.385996, 'last_price_update_time': 1777276812.38601, 'has_photos': True, 'auction_closing_time': 1777388668.0}
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_8f41c5bc4226cd6e0d71512ac644c4bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB18666> (referer: https://www.auto1.com/v1/car-details-view/VB18666/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c4b6d79d412eadee2aeddb48ae7ce33d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5516950>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_8f41c5bc4226cd6e0d71512ac644c4bd.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18e36070-76f8-5216-aa01-d17db219580c with identifier: VB18666
2026-04-27 08:00:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e36070-76f8-5216-aa01-d17db219580c with scrape type 1
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b7ed1161013f7a6be5a6c40427e1ea3b.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_7656b516afeb0afec2ac52a7e2ef7b59.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_d8b70f41af8223d4218194002cc1970e.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_15cc1fef1b4a6d4d94966d8463a9f2ab.jpg not downloaded yet
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c8f50>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c4b6d79d412eadee2aeddb48ae7ce33d.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2bf84344961af92d4e18e9816e1a6dd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_dcaf49474b85711fbf12278e09be2d2c.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_abbb853cf0bd3c4e711d5c60308dedfa.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_9ba4a579dcae592a2d5cb5d90ea7ce65.jpg not downloaded yet
2026-04-27 08:00:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2f15bd33fdecd24896e115a53cc91556.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b42b7cf4a3bf7f500b10f0c312fadb9f.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_617655dd38065d6f24b302ddf6aa3349.jpg not downloaded yet
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_791364ea6f7f50e0a7ce4c17e5940aa0.jpg not downloaded yet
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c6090>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2bf84344961af92d4e18e9816e1a6dd6.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c4750>
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2f15bd33fdecd24896e115a53cc91556.jpg saved to cache
2026-04-27 08:00:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_15cc1fef1b4a6d4d94966d8463a9f2ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_9ba4a579dcae592a2d5cb5d90ea7ce65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d7c90>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_15cc1fef1b4a6d4d94966d8463a9f2ab.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5891250>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_9ba4a579dcae592a2d5cb5d90ea7ce65.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_791364ea6f7f50e0a7ce4c17e5940aa0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_617655dd38065d6f24b302ddf6aa3349.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a7190>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_791364ea6f7f50e0a7ce4c17e5940aa0.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57534d0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_617655dd38065d6f24b302ddf6aa3349.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_abbb853cf0bd3c4e711d5c60308dedfa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b42b7cf4a3bf7f500b10f0c312fadb9f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af990>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_abbb853cf0bd3c4e711d5c60308dedfa.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead641d390>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b42b7cf4a3bf7f500b10f0c312fadb9f.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_d8b70f41af8223d4218194002cc1970e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_dcaf49474b85711fbf12278e09be2d2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b7ed1161013f7a6be5a6c40427e1ea3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c4950>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_d8b70f41af8223d4218194002cc1970e.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5968ad0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_dcaf49474b85711fbf12278e09be2d2c.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_7656b516afeb0afec2ac52a7e2ef7b59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b1d0>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b7ed1161013f7a6be5a6c40427e1ea3b.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD18129/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2de90>
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_7656b516afeb0afec2ac52a7e2ef7b59.jpg saved to cache
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18e36070-76f8-5216-aa01-d17db219580c
2026-04-27 08:00:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18e36070-76f8-5216-aa01-d17db219580c, skipping ID generation
2026-04-27 08:00:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18e36070-76f8-5216-aa01-d17db219580c with scrape type 1
2026-04-27 08:00:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18e36070-76f8-5216-aa01-d17db219580c sending to next pipeline
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18e36070-76f8-5216-aa01-d17db219580c, identifier: VB18666
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18e36070-76f8-5216-aa01-d17db219580c with identifier: VB18666
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18e36070-76f8-5216-aa01-d17db219580c with identifier: VB18666
2026-04-27 08:00:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18e36070-76f8-5216-aa01-d17db219580c with identifier: VB18666 to the API
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_7656b516afeb0afec2ac52a7e2ef7b59.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Senago',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:26:18Z',
'fuel_type': 'diesel',
'id': '18e36070-76f8-5216-aa01-d17db219580c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB18666',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Opel',
'model': 'Grandland X',
'odometer': 212687,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b7ed1161013f7a6be5a6c40427e1ea3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_7656b516afeb0afec2ac52a7e2ef7b59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52956,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_d8b70f41af8223d4218194002cc1970e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_15cc1fef1b4a6d4d94966d8463a9f2ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_dcaf49474b85711fbf12278e09be2d2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_abbb853cf0bd3c4e711d5c60308dedfa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_9ba4a579dcae592a2d5cb5d90ea7ce65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58972,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_b42b7cf4a3bf7f500b10f0c312fadb9f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_617655dd38065d6f24b302ddf6aa3349.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18e36070-76f8-5216-aa01-d17db219580c/18e36070-76f8-5216-aa01-d17db219580c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/d2/b4d20188ee994a95f26943c58e80efea/pa/VB18666_791364ea6f7f50e0a7ce4c17e5940aa0.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Grandland X 1.5 CDTI Design Line',
'transmission': 'automatic',
'trim': 'Design Line',
'year': 2021}
2026-04-27 08:00:14 [auto1.it] INFO: Saving data for VB18666: {'created_time': 1777276814.441053, 'last_price_update_time': 1777276814.441065, 'has_photos': True, 'auction_closing_time': 1777389978.0}
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_9c9daaaebb1501b5482ee9aa67442f4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c8362c7b07ec48ca7cea3d3b7b20581f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c0b6a3b8db11b1b5e393f5d90afa1d3d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MK90568/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2d4ecf578f942fb370b5d7bef14b3feb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5336050>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_9c9daaaebb1501b5482ee9aa67442f4b.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6355990>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c8362c7b07ec48ca7cea3d3b7b20581f.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cd610>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c0b6a3b8db11b1b5e393f5d90afa1d3d.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567de10>
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2d4ecf578f942fb370b5d7bef14b3feb.jpg saved to cache
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d
2026-04-27 08:00:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d, skipping ID generation
2026-04-27 08:00:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with scrape type 1
2026-04-27 08:00:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d sending to next pipeline
2026-04-27 08:00:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d, identifier: ST62394
2026-04-27 08:00:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with identifier: ST62394
2026-04-27 08:00:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with identifier: ST62394
2026-04-27 08:00:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d with identifier: ST62394 to the API
2026-04-27 08:00:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2d4ecf578f942fb370b5d7bef14b3feb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'category': None,
'city': 'Settimo Torinese',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:06:19Z',
'fuel_type': 'diesel',
'id': '9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST62394',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 150008,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97631,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2d4ecf578f942fb370b5d7bef14b3feb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_9c9daaaebb1501b5482ee9aa67442f4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96337,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c0b6a3b8db11b1b5e393f5d90afa1d3d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c8362c7b07ec48ca7cea3d3b7b20581f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2f15bd33fdecd24896e115a53cc91556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88911,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_db6452acef3e79dda17a3389969f2c91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_2bf84344961af92d4e18e9816e1a6dd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97931,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_955ab5a138af7576bba5e3b83d8e6687.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_c4b6d79d412eadee2aeddb48ae7ce33d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d/9a1ebc65-1aad-5d49-9b4e-4ef9b813c81d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga6/fe/a6fe483000af43e43d2bf02c2467a04b/pa/ST62394_8f41c5bc4226cd6e0d71512ac644c4bd.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2019-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Join',
'transmission': 'manual',
'trim': 'Join',
'year': 2019}
2026-04-27 08:00:15 [auto1.it] INFO: Saving data for ST62394: {'created_time': 1777276815.164616, 'last_price_update_time': 1777276815.164627, 'has_photos': True, 'auction_closing_time': 1777388779.0}
2026-04-27 08:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GB46284/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LR68259/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY98380/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW92714> (referer: https://www.auto1.com/v1/car-details-view/ZW92714/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with identifier: ZW92714
2026-04-27 08:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with scrape type 1
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f19bf3663d118ac3383c003b659f858e.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_11901d93ff229b5f233918626d88f091.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_e43daff57ba80a736aeceefd25b1eb4e.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_beb4f3b0d63b02b5fd0179e795f83d81.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_5e57cb71cfa317c3b116a2aab5c80a47.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_b667b4cc8093c41732aefe789cd0df5d.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_c5ef7bac3f55901cf6fdc16052edd6f5.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_9b6e1799d0c1e1174966649f563c5b0f.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f0a54bab2dc689eb2dec032b6550be45.jpg not downloaded yet
2026-04-27 08:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_091f327bfd44a52e5cb81dbe1c75da62.jpg not downloaded yet
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TA79833> (referer: https://www.auto1.com/v1/car-details-view/TA79833/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EU61805/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f0a54bab2dc689eb2dec032b6550be45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-04-27 08:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67e0110-345d-5849-b86c-b061341d9eb7 with scrape type 1
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_c05dac36876243b9c173e03d4fc0cea2.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_b91c461a9c71c871a0396afbde699ff2.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_de330b8c5785d5c5be077b7c21909b01.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_2dcc88dc1a650bf0d4e2a74b5e1f5e32.jpg not downloaded yet
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_091f327bfd44a52e5cb81dbe1c75da62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_4bb07b0aed9063ae66b9ae03478c59f4.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_af99e00a846049f48a9261ec44e9dce9.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_929099aa03ce0f4affd761df1b3e255d.jpg not downloaded yet
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ef1b8c15d1e3f44c4a28c14c3de38086.jpg not downloaded yet
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9b090>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f0a54bab2dc689eb2dec032b6550be45.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ca29387527a4002e85c28a9b6cbe39c4.jpg not downloaded yet
2026-04-27 08:00:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_9b6e1799d0c1e1174966649f563c5b0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_dfa8198ce1e4ee2a6bb7e73026a970cc.jpg not downloaded yet
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0c510>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_091f327bfd44a52e5cb81dbe1c75da62.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d7650>
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_9b6e1799d0c1e1174966649f563c5b0f.jpg saved to cache
2026-04-27 08:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ca29387527a4002e85c28a9b6cbe39c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5324950>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ca29387527a4002e85c28a9b6cbe39c4.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_dfa8198ce1e4ee2a6bb7e73026a970cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ef1b8c15d1e3f44c4a28c14c3de38086.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6590550>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_dfa8198ce1e4ee2a6bb7e73026a970cc.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5890490>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ef1b8c15d1e3f44c4a28c14c3de38086.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_929099aa03ce0f4affd761df1b3e255d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2e410>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_929099aa03ce0f4affd761df1b3e255d.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_af99e00a846049f48a9261ec44e9dce9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65913d0>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_af99e00a846049f48a9261ec44e9dce9.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_4bb07b0aed9063ae66b9ae03478c59f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5516050>
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_4bb07b0aed9063ae66b9ae03478c59f4.jpg saved to cache
2026-04-27 08:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_2dcc88dc1a650bf0d4e2a74b5e1f5e32.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65913d0>
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_2dcc88dc1a650bf0d4e2a74b5e1f5e32.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_de330b8c5785d5c5be077b7c21909b01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6356090>
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_de330b8c5785d5c5be077b7c21909b01.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_b91c461a9c71c871a0396afbde699ff2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_c05dac36876243b9c173e03d4fc0cea2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5842150>
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_b91c461a9c71c871a0396afbde699ff2.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5738190>
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_c05dac36876243b9c173e03d4fc0cea2.jpg saved to cache
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b67e0110-345d-5849-b86c-b061341d9eb7
2026-04-27 08:00:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b67e0110-345d-5849-b86c-b061341d9eb7, skipping ID generation
2026-04-27 08:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b67e0110-345d-5849-b86c-b061341d9eb7 with scrape type 1
2026-04-27 08:00:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b67e0110-345d-5849-b86c-b061341d9eb7 sending to next pipeline
2026-04-27 08:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b67e0110-345d-5849-b86c-b061341d9eb7, identifier: TA79833
2026-04-27 08:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-04-27 08:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833
2026-04-27 08:00:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b67e0110-345d-5849-b86c-b061341d9eb7 with identifier: TA79833 to the API
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_c05dac36876243b9c173e03d4fc0cea2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.4L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:35:42Z',
'fuel_type': 'petrol',
'id': 'b67e0110-345d-5849-b86c-b061341d9eb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA79833',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Jeep',
'model': 'Compass',
'odometer': 83007,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_c05dac36876243b9c173e03d4fc0cea2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_b91c461a9c71c871a0396afbde699ff2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_de330b8c5785d5c5be077b7c21909b01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_2dcc88dc1a650bf0d4e2a74b5e1f5e32.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57104,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_4bb07b0aed9063ae66b9ae03478c59f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_af99e00a846049f48a9261ec44e9dce9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_929099aa03ce0f4affd761df1b3e255d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ef1b8c15d1e3f44c4a28c14c3de38086.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70639,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_ca29387527a4002e85c28a9b6cbe39c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b67e0110-345d-5849-b86c-b061341d9eb7/b67e0110-345d-5849-b86c-b061341d9eb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/52/5352b73fd8ab33ae3af22049d6a71b8a/pa/TA79833_dfa8198ce1e4ee2a6bb7e73026a970cc.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2019-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.4 M-Air Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2019}
2026-04-27 08:00:24 [auto1.it] INFO: Saving data for TA79833: {'created_time': 1777276824.060769, 'last_price_update_time': 1777276824.060781, 'has_photos': True, 'auction_closing_time': 1777390542.0}
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_c5ef7bac3f55901cf6fdc16052edd6f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567c790>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_c5ef7bac3f55901cf6fdc16052edd6f5.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_b667b4cc8093c41732aefe789cd0df5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476a10>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_b667b4cc8093c41732aefe789cd0df5d.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_5e57cb71cfa317c3b116a2aab5c80a47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_beb4f3b0d63b02b5fd0179e795f83d81.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d7f10>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_5e57cb71cfa317c3b116a2aab5c80a47.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d58d0>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_beb4f3b0d63b02b5fd0179e795f83d81.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_e43daff57ba80a736aeceefd25b1eb4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6477590>
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_e43daff57ba80a736aeceefd25b1eb4e.jpg saved to cache
2026-04-27 08:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_11901d93ff229b5f233918626d88f091.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f19bf3663d118ac3383c003b659f858e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5515bd0>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_11901d93ff229b5f233918626d88f091.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65931d0>
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f19bf3663d118ac3383c003b659f858e.jpg saved to cache
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726
2026-04-27 08:00:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 03229a5e-5b4c-5d8c-9d64-aca6b371f726, skipping ID generation
2026-04-27 08:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with scrape type 1
2026-04-27 08:00:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 03229a5e-5b4c-5d8c-9d64-aca6b371f726 sending to next pipeline
2026-04-27 08:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 03229a5e-5b4c-5d8c-9d64-aca6b371f726, identifier: ZW92714
2026-04-27 08:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with identifier: ZW92714
2026-04-27 08:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with identifier: ZW92714
2026-04-27 08:00:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 03229a5e-5b4c-5d8c-9d64-aca6b371f726 with identifier: ZW92714 to the API
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f19bf3663d118ac3383c003b659f858e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Milazzo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:38:07Z',
'fuel_type': 'hybrid',
'id': '03229a5e-5b4c-5d8c-9d64-aca6b371f726',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW92714',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Honda',
'model': 'HR-V',
'odometer': 24837,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f19bf3663d118ac3383c003b659f858e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_11901d93ff229b5f233918626d88f091.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_e43daff57ba80a736aeceefd25b1eb4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51036,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_beb4f3b0d63b02b5fd0179e795f83d81.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_5e57cb71cfa317c3b116a2aab5c80a47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_b667b4cc8093c41732aefe789cd0df5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_c5ef7bac3f55901cf6fdc16052edd6f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_9b6e1799d0c1e1174966649f563c5b0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67675,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_f0a54bab2dc689eb2dec032b6550be45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_03229a5e-5b4c-5d8c-9d64-aca6b371f726/03229a5e-5b4c-5d8c-9d64-aca6b371f726_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50207,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga7/ea/a7ea62733f0afa5fa86a82b414f04a77/pa/ZW92714_091f327bfd44a52e5cb81dbe1c75da62.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2024-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'Honda HR-V 1.5 i-MMD Hybrid Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2024}
2026-04-27 08:00:25 [auto1.it] INFO: Saving data for ZW92714: {'created_time': 1777276825.65724, 'last_price_update_time': 1777276825.65725, 'has_photos': True, 'auction_closing_time': 1777390687.0}
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JT08977/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN50903/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE39118> (referer: https://www.auto1.com/v1/car-details-view/UE39118/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cbbf375-25a5-5ef0-a233-bd603cabffde with identifier: UE39118
2026-04-27 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cbbf375-25a5-5ef0-a233-bd603cabffde with scrape type 1
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_fdfe1163844cd0efaf361268f7c29dda.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_47f3ad7d90aab235e19dc336ee57dfa5.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_a47462b616634a56419a1a92caf9f5ac.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_61d1fe63c7938a75a3592e9344c54072.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_97044ea6fee953d85df31e1659eb3e59.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_256540d9368663b4401a675944ecc12f.jpg not downloaded yet
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV11446/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_256540d9368663b4401a675944ecc12f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b3550>
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_256540d9368663b4401a675944ecc12f.jpg saved to cache
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SK61077/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD18129> (referer: https://www.auto1.com/v1/car-details-view/BD18129/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-04-27 08:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 with scrape type 1
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg not downloaded yet
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg not downloaded yet
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_97044ea6fee953d85df31e1659eb3e59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg not downloaded yet
2026-04-27 08:00:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_61d1fe63c7938a75a3592e9344c54072.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg not downloaded yet
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg not downloaded yet
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg not downloaded yet
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg not downloaded yet
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg not downloaded yet
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead636a810>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_97044ea6fee953d85df31e1659eb3e59.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5786c10>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_61d1fe63c7938a75a3592e9344c54072.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4b04850>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b91d0>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589c050>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55ca590>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af4550>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d1c10>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d7dd0>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5950>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6329b90>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5768290>
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg saved to cache
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f7005b13-c60f-5c0b-8bb1-128a46e03f89
2026-04-27 08:00:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f7005b13-c60f-5c0b-8bb1-128a46e03f89, skipping ID generation
2026-04-27 08:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 with scrape type 1
2026-04-27 08:00:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f7005b13-c60f-5c0b-8bb1-128a46e03f89 sending to next pipeline
2026-04-27 08:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f7005b13-c60f-5c0b-8bb1-128a46e03f89, identifier: BD18129
2026-04-27 08:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-04-27 08:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129
2026-04-27 08:00:31 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f7005b13-c60f-5c0b-8bb1-128a46e03f89 with identifier: BD18129 to the API
2026-04-27 08:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:20:49Z',
'fuel_type': 'diesel',
'id': 'f7005b13-c60f-5c0b-8bb1-128a46e03f89',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD18129',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Renault',
'model': 'Kangoo',
'odometer': 173795,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73841,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_ddd6f1357ba294b2bd231f5ca3e175b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_545e13fadfe577529da51540fad9ca38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_4916ab39fc725a87a7d0b3b22d13eca8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_addd01110743fbe9636f49725018b908.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_5ad90f17a61fdcb8af4a03d6855a3022.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_c8c82dfe1c45e7f72dcbfbf8e765a3ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71129,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_391704cdb0129d09303c080657847844.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71677,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_260f9e62f1a0f55c992112e402f2a307.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_8562bb8cbe36bffbd6bd568d9ec6803b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f7005b13-c60f-5c0b-8bb1-128a46e03f89/f7005b13-c60f-5c0b-8bb1-128a46e03f89_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67901,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img98/4a/984a3fafc25ab3ad99953e8df5d6c760/pa/BD18129_08cb586b8b0486f1c8874952308498eb.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2008-04-09',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Kangoo 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2008}
2026-04-27 08:00:32 [auto1.it] INFO: Saving data for BD18129: {'created_time': 1777276832.145338, 'last_price_update_time': 1777276832.145351, 'has_photos': True, 'auction_closing_time': 1777389649.0}
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_a47462b616634a56419a1a92caf9f5ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GB46284> (referer: https://www.auto1.com/v1/car-details-view/GB46284/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3490>
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_a47462b616634a56419a1a92caf9f5ac.jpg saved to cache
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:32 [auto1.it] INFO: Channel: 24h | Page: 8 | totalHits: 3113 | hits on page: 40
2026-04-27 08:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 717b69a6-4363-561b-8fac-ad2d9a5471bb with identifier: GB46284
2026-04-27 08:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717b69a6-4363-561b-8fac-ad2d9a5471bb with scrape type 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_fb51c4d1e7936ca83e964f46fdee9be6.jpg not downloaded yet
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: JT08977
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_40d7bda19ea6b7ec34e16e7994523208.jpg not downloaded yet
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: HN50903
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_e214668c74d183ae21f3704e2e47e2d0.jpg not downloaded yet
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_47f3ad7d90aab235e19dc336ee57dfa5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: GY98380
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6acfacca92172949f9ed9af7736c7057.jpg not downloaded yet
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: YM08087
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for YM08087: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_7eda5fd11f6259dd4af9c1e6726b9409.jpg not downloaded yet
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: NN80859
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for NN80859: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_483e18f8052e7dedc5108c1cf1986fdb.jpg not downloaded yet
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_fdfe1163844cd0efaf361268f7c29dda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: ZW61080
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for ZW61080: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6d155f45ad89f99d756c5fb11a99ca26.jpg not downloaded yet
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: AA15878
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for AA15878: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_0a9bcf786ec08678bbf8c51407d66738.jpg not downloaded yet
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_e214668c74d183ae21f3704e2e47e2d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: ME27860
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for ME27860: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_d912e7b2344807f27b1fd418556f7545.jpg not downloaded yet
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead659e9d0>
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_47f3ad7d90aab235e19dc336ee57dfa5.jpg saved to cache
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:32 [auto1.it] INFO: Found listing with ID: EP42910
2026-04-27 08:00:32 [auto1.it] INFO: Scrape type for EP42910: 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_ba8b33b67b8e9617d0f90fbb6934cab3.jpg not downloaded yet
2026-04-27 08:00:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_483e18f8052e7dedc5108c1cf1986fdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d510>
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_fdfe1163844cd0efaf361268f7c29dda.jpg saved to cache
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6cbbf375-25a5-5ef0-a233-bd603cabffde
2026-04-27 08:00:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6cbbf375-25a5-5ef0-a233-bd603cabffde, skipping ID generation
2026-04-27 08:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cbbf375-25a5-5ef0-a233-bd603cabffde with scrape type 1
2026-04-27 08:00:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6cbbf375-25a5-5ef0-a233-bd603cabffde sending to next pipeline
2026-04-27 08:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6cbbf375-25a5-5ef0-a233-bd603cabffde, identifier: UE39118
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: GY56405
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for GY56405: 1
2026-04-27 08:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6cbbf375-25a5-5ef0-a233-bd603cabffde with identifier: UE39118
2026-04-27 08:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6cbbf375-25a5-5ef0-a233-bd603cabffde with identifier: UE39118
2026-04-27 08:00:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6cbbf375-25a5-5ef0-a233-bd603cabffde with identifier: UE39118 to the API
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_fdfe1163844cd0efaf361268f7c29dda.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': 'Rental',
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 160,
'expiration_date': '2026-04-28T15:21:59Z',
'fuel_type': 'diesel',
'id': '6cbbf375-25a5-5ef0-a233-bd603cabffde',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE39118',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Opel',
'model': 'Insignia Sports Tourer',
'odometer': 260879,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75924,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_fdfe1163844cd0efaf361268f7c29dda.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_47f3ad7d90aab235e19dc336ee57dfa5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_a47462b616634a56419a1a92caf9f5ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60886,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_61d1fe63c7938a75a3592e9344c54072.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_97044ea6fee953d85df31e1659eb3e59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6cbbf375-25a5-5ef0-a233-bd603cabffde/6cbbf375-25a5-5ef0-a233-bd603cabffde_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/92/9a92574439c7d5bd6c9f1ad55d157683/pa/UE39118_256540d9368663b4401a675944ecc12f.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2010-10-19',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Insignia Sports Tourer 2.0 CDTI Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2010}
2026-04-27 08:00:33 [auto1.it] INFO: Saving data for UE39118: {'created_time': 1777276833.399283, 'last_price_update_time': 1777276833.399293, 'has_photos': True, 'auction_closing_time': 1777389719.0}
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_0a9bcf786ec08678bbf8c51407d66738.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: EC17055
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for EC17055: 1
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LR68259> (referer: https://www.auto1.com/v1/car-details-view/LR68259/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e2710>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_e214668c74d183ae21f3704e2e47e2d0.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5893f90>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_483e18f8052e7dedc5108c1cf1986fdb.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY98380> (referer: https://www.auto1.com/v1/car-details-view/GY98380/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MK90568> (referer: https://www.auto1.com/v1/car-details-view/MK90568/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: XT85815
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for XT85815: 1
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_d912e7b2344807f27b1fd418556f7545.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: DC14157
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for DC14157: 1
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bf710>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_0a9bcf786ec08678bbf8c51407d66738.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: WN90008
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for WN90008: 1
2026-04-27 08:00:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_ba8b33b67b8e9617d0f90fbb6934cab3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with scrape type 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: EB58973
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for EB58973: 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: JH93132
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for JH93132: 1
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa660a89-4cff-55f1-9861-d70f588c35b3 with identifier: GY98380
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa660a89-4cff-55f1-9861-d70f588c35b3 with scrape type 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_d59db95c43175becdbcc6f55f4a867b1.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with identifier: MK90568
2026-04-27 08:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with scrape type 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_be7c429d666544c23812f9c52be71219.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg not downloaded yet
2026-04-27 08:00:33 [auto1.it] INFO: Found listing with ID: NW41660
2026-04-27 08:00:33 [auto1.it] INFO: Scrape type for NW41660: 1
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5ab1d965cc841e4f9caa190f54c7f211.jpg not downloaded yet
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_c3808d6f7a69dc49b8c5b6139dcdeb53.jpg not downloaded yet
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e550>
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_d912e7b2344807f27b1fd418556f7545.jpg saved to cache
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: MM75159
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for MM75159: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_30065954273aeee680efbe9a868bc2c4.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_d20e286e1a48fbe685e66b977653c5c0.jpg not downloaded yet
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65daed0>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_ba8b33b67b8e9617d0f90fbb6934cab3.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: CH87663
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for CH87663: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_27294199e59bb4e786c648e87b250a1c.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b8bd9da17abb8bd337b92168e2ce381e.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: LF46608
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for LF46608: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_7ed3c54a793b3ba14ad92c3570e6323a.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_62aba7074c1e1499ccfe44af5ae19bea.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: TN35413
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for TN35413: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_0aac1cc1465fe27e7dcef432ba042278.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_81b5e9c6527d615a6bc3beec2cb0a95b.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: MJ42614
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for MJ42614: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_6a636ef49c77b8120b41ce3f6376ef6c.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_e48eb33a40ca776d17c248480638c7e6.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: JB66719
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for JB66719: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_005502ce7fa29afa09aa47cd3c4d96ba.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b6bf45df4d37abeca8230b7093c09a4e.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg not downloaded yet
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: ZC15371
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for ZC15371: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_fcdbb43b4b63edb8a6a4598202d1bf4d.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_03a774a0a0681a1694027c3b13d2abd1.jpg not downloaded yet
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BT13926/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: TD68261
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for TD68261: 1
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5b057478f0f59291921c49edcaa3043e.jpg not downloaded yet
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_f572c9927dde5bd75896450c916986fc.jpg not downloaded yet
2026-04-27 08:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: YU29433
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for YU29433: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: RE51399
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for RE51399: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: WY26414
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for WY26414: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: XB11924
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for XB11924: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: GT34435
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for GT34435: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: WZ30101
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for WZ30101: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: FP12220
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for FP12220: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: JD11535
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for JD11535: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: HB10468
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for HB10468: 1
2026-04-27 08:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_03a774a0a0681a1694027c3b13d2abd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: BN85160
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for BN85160: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: YB68272
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for YB68272: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: BD69591
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for BD69591: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: XP72573
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for XP72573: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: VD09142
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for VD09142: 1
2026-04-27 08:00:34 [auto1.it] INFO: Found listing with ID: SJ15806
2026-04-27 08:00:34 [auto1.it] INFO: Scrape type for SJ15806: 1
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6477290>
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_03a774a0a0681a1694027c3b13d2abd1.jpg saved to cache
2026-04-27 08:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:00:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UW55745> (referer: https://www.auto1.com/v1/car-details-view/UW55745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 418b0ca0-3d3b-5134-9911-766475e1a421 with identifier: UW55745
2026-04-27 08:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418b0ca0-3d3b-5134-9911-766475e1a421 with scrape type 1
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_5ec2f1facc03e25a95d4ef348e79d8f1.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_03cfe69620710b35235c1b252f34f5f2.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_a53918b0d55f8bbe875167abeb405c8b.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_1ad11bdd7938d51608602ebc4463d1fb.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_d1c745db7a2a2b7c46d8c374be994729.jpg not downloaded yet
2026-04-27 08:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_39ab2055140abc64b294eed98af554d5.jpg not downloaded yet
2026-04-27 08:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SK61077> (referer: https://www.auto1.com/v1/car-details-view/SK61077/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79a0177e-ea18-5af8-80e7-e68687981c35 with identifier: SK61077
2026-04-27 08:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a0177e-ea18-5af8-80e7-e68687981c35 with scrape type 1
2026-04-27 08:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_f3f366c5477022444d3a806e26f4d988.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_1d72c14b07b819d97325123b110b04b1.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_39ab2055140abc64b294eed98af554d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_3dde2e736157bf22d62e9bbc2c011556.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_492cfdccf66c228f21b9aa3f02026ac0.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_c799b64a0d351611710fab3f9b338816.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_0da05ca6dedfbfa388917c62874657cf.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_36de598726145574c45f3a4ee995aa7c.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d4a381010d9b9d3f874aec953e04b421.jpg not downloaded yet
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_1d72c14b07b819d97325123b110b04b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d8aac44392eb4e4c9bcc1526a0fa02a2.jpg not downloaded yet
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_40cdb6443b658f15524ee4b3aaa6ef4c.jpg not downloaded yet
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547d110>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_39ab2055140abc64b294eed98af554d5.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5454090>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_1d72c14b07b819d97325123b110b04b1.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d4a381010d9b9d3f874aec953e04b421.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_40cdb6443b658f15524ee4b3aaa6ef4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a0590>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d4a381010d9b9d3f874aec953e04b421.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d8aac44392eb4e4c9bcc1526a0fa02a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596b690>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_40cdb6443b658f15524ee4b3aaa6ef4c.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_36de598726145574c45f3a4ee995aa7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5966e90>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d8aac44392eb4e4c9bcc1526a0fa02a2.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_0da05ca6dedfbfa388917c62874657cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549e290>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_36de598726145574c45f3a4ee995aa7c.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586e850>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_0da05ca6dedfbfa388917c62874657cf.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_c799b64a0d351611710fab3f9b338816.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_492cfdccf66c228f21b9aa3f02026ac0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564cfd0>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_c799b64a0d351611710fab3f9b338816.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5966950>
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_492cfdccf66c228f21b9aa3f02026ac0.jpg saved to cache
2026-04-27 08:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_3dde2e736157bf22d62e9bbc2c011556.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_f3f366c5477022444d3a806e26f4d988.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564cfd0>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_3dde2e736157bf22d62e9bbc2c011556.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_d1c745db7a2a2b7c46d8c374be994729.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6477590>
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_f3f366c5477022444d3a806e26f4d988.jpg saved to cache
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79a0177e-ea18-5af8-80e7-e68687981c35
2026-04-27 08:00:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79a0177e-ea18-5af8-80e7-e68687981c35, skipping ID generation
2026-04-27 08:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79a0177e-ea18-5af8-80e7-e68687981c35 with scrape type 1
2026-04-27 08:00:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79a0177e-ea18-5af8-80e7-e68687981c35 sending to next pipeline
2026-04-27 08:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 79a0177e-ea18-5af8-80e7-e68687981c35, identifier: SK61077
2026-04-27 08:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 79a0177e-ea18-5af8-80e7-e68687981c35 with identifier: SK61077
2026-04-27 08:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 79a0177e-ea18-5af8-80e7-e68687981c35 with identifier: SK61077
2026-04-27 08:00:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 79a0177e-ea18-5af8-80e7-e68687981c35 with identifier: SK61077 to the API
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_f3f366c5477022444d3a806e26f4d988.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Padova',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:23:09Z',
'fuel_type': 'diesel',
'id': '79a0177e-ea18-5af8-80e7-e68687981c35',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SK61077',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'BMW',
'model': '1er',
'odometer': 231473,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80238,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_f3f366c5477022444d3a806e26f4d988.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80374,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_1d72c14b07b819d97325123b110b04b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_3dde2e736157bf22d62e9bbc2c011556.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_492cfdccf66c228f21b9aa3f02026ac0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73534,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_c799b64a0d351611710fab3f9b338816.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_0da05ca6dedfbfa388917c62874657cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61013,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_36de598726145574c45f3a4ee995aa7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d4a381010d9b9d3f874aec953e04b421.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_d8aac44392eb4e4c9bcc1526a0fa02a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_79a0177e-ea18-5af8-80e7-e68687981c35/79a0177e-ea18-5af8-80e7-e68687981c35_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59572,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img71/40/7140e321c6b6ff316835061f0d0b1ae1/pa/SK61077_40cdb6443b658f15524ee4b3aaa6ef4c.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2017-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2017}
2026-04-27 08:00:57 [auto1.it] INFO: Saving data for SK61077: {'created_time': 1777276857.870821, 'last_price_update_time': 1777276857.870833, 'has_photos': True, 'auction_closing_time': 1777389789.0}
2026-04-27 08:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_1ad11bdd7938d51608602ebc4463d1fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63285d0>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_d1c745db7a2a2b7c46d8c374be994729.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548ef10>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_1ad11bdd7938d51608602ebc4463d1fb.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_a53918b0d55f8bbe875167abeb405c8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_03cfe69620710b35235c1b252f34f5f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b1fd0>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_a53918b0d55f8bbe875167abeb405c8b.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_5ec2f1facc03e25a95d4ef348e79d8f1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5884110>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_03cfe69620710b35235c1b252f34f5f2.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5884750>
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:00:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_5ec2f1facc03e25a95d4ef348e79d8f1.jpg saved to cache
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 418b0ca0-3d3b-5134-9911-766475e1a421
2026-04-27 08:00:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 418b0ca0-3d3b-5134-9911-766475e1a421, skipping ID generation
2026-04-27 08:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 418b0ca0-3d3b-5134-9911-766475e1a421 with scrape type 1
2026-04-27 08:00:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 418b0ca0-3d3b-5134-9911-766475e1a421 sending to next pipeline
2026-04-27 08:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 418b0ca0-3d3b-5134-9911-766475e1a421, identifier: UW55745
2026-04-27 08:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 418b0ca0-3d3b-5134-9911-766475e1a421 with identifier: UW55745
2026-04-27 08:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 418b0ca0-3d3b-5134-9911-766475e1a421 with identifier: UW55745
2026-04-27 08:00:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 418b0ca0-3d3b-5134-9911-766475e1a421 with identifier: UW55745 to the API
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:00:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_5ec2f1facc03e25a95d4ef348e79d8f1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 189,
'category': None,
'city': 'Milazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.2L',
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:53:46Z',
'fuel_type': 'diesel',
'id': '418b0ca0-3d3b-5134-9911-766475e1a421',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UW55745',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Citroen',
'model': 'C-Crosser',
'odometer': 336386,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_5ec2f1facc03e25a95d4ef348e79d8f1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89835,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_03cfe69620710b35235c1b252f34f5f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103620,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_a53918b0d55f8bbe875167abeb405c8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_1ad11bdd7938d51608602ebc4463d1fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_d1c745db7a2a2b7c46d8c374be994729.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_418b0ca0-3d3b-5134-9911-766475e1a421/418b0ca0-3d3b-5134-9911-766475e1a421_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6d/03/6d03fe78722841ae333fa9c2c96c0e4e/pa/UW55745_39ab2055140abc64b294eed98af554d5.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2011-06-12',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C-Crosser 2.2 HDi Seduction',
'transmission': 'automatic',
'trim': 'Seduction',
'year': 2011}
2026-04-27 08:00:58 [auto1.it] INFO: Saving data for UW55745: {'created_time': 1777276858.967999, 'last_price_update_time': 1777276858.96801, 'has_photos': True, 'auction_closing_time': 1777391626.0}
2026-04-27 08:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JT08977> (referer: https://www.auto1.com/v1/car-details-view/JT08977/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-04-27 08:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with scrape type 1
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_47bc2e7f5a9f7c9693acea5b1878aab7.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_a6a9340115a27068411e1edd174a7386.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_7758d3fbbbce40c295b7cdf5058e24cb.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_325d68b2f3d3ab6cf6cdf0657fd55145.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_d95486bd1ef091c6c72bd31386e4869d.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_9529dcf9e226475122fa6c03b22a1ec6.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_3a72bb9e7ed2f571229a51ba791012df.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_ba8daec66bc03cfbeea954afcda03de2.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_1b6835f5f19847eb04ff539890d78c4c.jpg not downloaded yet
2026-04-27 08:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_c28252876885e3ea758356a3b84ee27e.jpg not downloaded yet
2026-04-27 08:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GY56405/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_c28252876885e3ea758356a3b84ee27e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e6d0>
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_c28252876885e3ea758356a3b84ee27e.jpg saved to cache
2026-04-27 08:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV11446> (referer: https://www.auto1.com/v1/car-details-view/CV11446/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4da49cbb-99bd-5e11-a856-e46b22a152a2 with identifier: CV11446
2026-04-27 08:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da49cbb-99bd-5e11-a856-e46b22a152a2 with scrape type 1
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_f0ec428a86b944e2e72ef17537ea5c19.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9cf8971eaf11e0c8220fd98083ff2a89.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_1e5dd191b49b2a6559795baf50e8fa68.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9f6dade2dee4157d0b1cb1d383ecfa63.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_df9385a64b2bba3c774e20825e016ae2.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_0e258c563cd1eb07958c0d1b971b932f.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e8c4510dbdbbc803b146584ad78f2f77.jpg not downloaded yet
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_1b6835f5f19847eb04ff539890d78c4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e0137089f4e50278ba4babb7f76c6b72.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_ecc04e2ef4dc95abbcdb684130491b93.jpg not downloaded yet
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_975c8c7de3183180a863db0192208603.jpg not downloaded yet
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead586fa10>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_1b6835f5f19847eb04ff539890d78c4c.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e8c4510dbdbbc803b146584ad78f2f77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5940c90>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e8c4510dbdbbc803b146584ad78f2f77.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_975c8c7de3183180a863db0192208603.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547f990>
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_975c8c7de3183180a863db0192208603.jpg saved to cache
2026-04-27 08:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_ecc04e2ef4dc95abbcdb684130491b93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e0137089f4e50278ba4babb7f76c6b72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5890>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_ecc04e2ef4dc95abbcdb684130491b93.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7010>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e0137089f4e50278ba4babb7f76c6b72.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_0e258c563cd1eb07958c0d1b971b932f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5a10>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_0e258c563cd1eb07958c0d1b971b932f.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_df9385a64b2bba3c774e20825e016ae2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943750>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_df9385a64b2bba3c774e20825e016ae2.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9f6dade2dee4157d0b1cb1d383ecfa63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5890f90>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9f6dade2dee4157d0b1cb1d383ecfa63.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_1e5dd191b49b2a6559795baf50e8fa68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5628ed0>
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_1e5dd191b49b2a6559795baf50e8fa68.jpg saved to cache
2026-04-27 08:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9cf8971eaf11e0c8220fd98083ff2a89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_f0ec428a86b944e2e72ef17537ea5c19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5885c90>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9cf8971eaf11e0c8220fd98083ff2a89.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562b290>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_f0ec428a86b944e2e72ef17537ea5c19.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4da49cbb-99bd-5e11-a856-e46b22a152a2
2026-04-27 08:01:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4da49cbb-99bd-5e11-a856-e46b22a152a2, skipping ID generation
2026-04-27 08:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4da49cbb-99bd-5e11-a856-e46b22a152a2 with scrape type 1
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4da49cbb-99bd-5e11-a856-e46b22a152a2 sending to next pipeline
2026-04-27 08:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4da49cbb-99bd-5e11-a856-e46b22a152a2, identifier: CV11446
2026-04-27 08:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4da49cbb-99bd-5e11-a856-e46b22a152a2 with identifier: CV11446
2026-04-27 08:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4da49cbb-99bd-5e11-a856-e46b22a152a2 with identifier: CV11446
2026-04-27 08:01:09 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4da49cbb-99bd-5e11-a856-e46b22a152a2 with identifier: CV11446 to the API
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_f0ec428a86b944e2e72ef17537ea5c19.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': 'Rental',
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.5L',
'engine_horse_power': 103,
'expiration_date': '2026-04-28T15:08:19Z',
'fuel_type': 'diesel',
'id': '4da49cbb-99bd-5e11-a856-e46b22a152a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV11446',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 85926,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_f0ec428a86b944e2e72ef17537ea5c19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9cf8971eaf11e0c8220fd98083ff2a89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_1e5dd191b49b2a6559795baf50e8fa68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54928,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_9f6dade2dee4157d0b1cb1d383ecfa63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66393,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_df9385a64b2bba3c774e20825e016ae2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66791,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_0e258c563cd1eb07958c0d1b971b932f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e8c4510dbdbbc803b146584ad78f2f77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_e0137089f4e50278ba4babb7f76c6b72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73984,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_ecc04e2ef4dc95abbcdb684130491b93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4da49cbb-99bd-5e11-a856-e46b22a152a2/4da49cbb-99bd-5e11-a856-e46b22a152a2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64175,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/4c/5c4cb2159e659b34acc2339dde58e0a5/pa/CV11446_975c8c7de3183180a863db0192208603.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2010-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 dCi Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2010}
2026-04-27 08:01:09 [auto1.it] INFO: Saving data for CV11446: {'created_time': 1777276869.770548, 'last_price_update_time': 1777276869.770563, 'has_photos': True, 'auction_closing_time': 1777388899.0}
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_ba8daec66bc03cfbeea954afcda03de2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547d650>
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_ba8daec66bc03cfbeea954afcda03de2.jpg saved to cache
2026-04-27 08:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_3a72bb9e7ed2f571229a51ba791012df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6357f90>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_3a72bb9e7ed2f571229a51ba791012df.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [scrapy.extensions.logstats] INFO: Crawled 408 pages (at 29 pages/min), scraped 164 items (at 10 items/min)
2026-04-27 08:01:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_9529dcf9e226475122fa6c03b22a1ec6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5940710>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_9529dcf9e226475122fa6c03b22a1ec6.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_d95486bd1ef091c6c72bd31386e4869d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e52d0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_d95486bd1ef091c6c72bd31386e4869d.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_325d68b2f3d3ab6cf6cdf0657fd55145.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6357650>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_325d68b2f3d3ab6cf6cdf0657fd55145.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_7758d3fbbbce40c295b7cdf5058e24cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_a6a9340115a27068411e1edd174a7386.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6150>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_7758d3fbbbce40c295b7cdf5058e24cb.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_47bc2e7f5a9f7c9693acea5b1878aab7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5964dd0>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_a6a9340115a27068411e1edd174a7386.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593e350>
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_47bc2e7f5a9f7c9693acea5b1878aab7.jpg saved to cache
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500
2026-04-27 08:01:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500, skipping ID generation
2026-04-27 08:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with scrape type 1
2026-04-27 08:01:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 sending to next pipeline
2026-04-27 08:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500, identifier: JT08977
2026-04-27 08:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-04-27 08:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977
2026-04-27 08:01:11 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9678c286-d0c6-5dbf-aa29-65fe1a0cb500 with identifier: JT08977 to the API
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:11 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_47bc2e7f5a9f7c9693acea5b1878aab7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:08:41Z',
'fuel_type': 'petrol',
'id': '9678c286-d0c6-5dbf-aa29-65fe1a0cb500',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JT08977',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Opel',
'model': 'Astra',
'odometer': 74204,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_47bc2e7f5a9f7c9693acea5b1878aab7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_a6a9340115a27068411e1edd174a7386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_7758d3fbbbce40c295b7cdf5058e24cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67397,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_325d68b2f3d3ab6cf6cdf0657fd55145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_d95486bd1ef091c6c72bd31386e4869d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_9529dcf9e226475122fa6c03b22a1ec6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67627,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_3a72bb9e7ed2f571229a51ba791012df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99826,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_ba8daec66bc03cfbeea954afcda03de2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_1b6835f5f19847eb04ff539890d78c4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9678c286-d0c6-5dbf-aa29-65fe1a0cb500/9678c286-d0c6-5dbf-aa29-65fe1a0cb500_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74045,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/bb/57bbb9f4eb9d0cbe5bc3141e500df778/pa/JT08977_c28252876885e3ea758356a3b84ee27e.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-03-31',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.4 SIDI Turbo Innovation Start&Stop',
'transmission': 'manual',
'trim': 'Innovation Start&Stop',
'year': 2016}
2026-04-27 08:01:11 [auto1.it] INFO: Saving data for JT08977: {'created_time': 1777276871.556637, 'last_price_update_time': 1777276871.55665, 'has_photos': True, 'auction_closing_time': 1777388921.0}
2026-04-27 08:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EP42910/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ME27860/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DC14157/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EC17055/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HB10468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SJ15806/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VD09142/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GY56405> (referer: https://www.auto1.com/v1/car-details-view/GY56405/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7b79b45-edb4-5fff-b7e9-832d02da9e3b with identifier: GY56405
2026-04-27 08:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b with scrape type 1
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ff9d05a90080322c63d58bb9813a75a0.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_a698c97440eebab4e8a54ad0f82611f3.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_82edf4c2192e9b86a66d15af1c49a8c5.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_0f5c646363f992da018745aad90bedb2.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_b22d6ea8feb6d4e4b1e9cceec6733bcf.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_14e4b9e73381999bd30ce18e65465b4d.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_28d71d759074761155af6fd7d944d857.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_e3c4f32f071055689d1e6b1a48927310.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ef7dd86253937d4503c5fe59440da446.jpg not downloaded yet
2026-04-27 08:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_16e3fbfd67b3b9db446f9487ce28eecf.jpg not downloaded yet
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BD69591/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_16e3fbfd67b3b9db446f9487ce28eecf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815610>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_16e3fbfd67b3b9db446f9487ce28eecf.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XP72573/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ef7dd86253937d4503c5fe59440da446.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_e3c4f32f071055689d1e6b1a48927310.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5891b50>
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ef7dd86253937d4503c5fe59440da446.jpg saved to cache
2026-04-27 08:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56deb50>
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_e3c4f32f071055689d1e6b1a48927310.jpg saved to cache
2026-04-27 08:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YB68272/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EP42910> (referer: https://www.auto1.com/v1/car-details-view/EP42910/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f6a214c-b143-5ccc-9335-24b1eb238a6b with identifier: EP42910
2026-04-27 08:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b with scrape type 1
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_e88d262f278c1166f59ec6d3dd210cd4.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_374108018dcfe4773a1b642a7d4a11b5.jpg not downloaded yet
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_28d71d759074761155af6fd7d944d857.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_0fe6cbf2399a601d6ce89509e5c92e1d.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_c182485b88f3e3d6ad3693467de7e79c.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_52d2ab86081292cb1e465df5a2b1d4ce.jpg not downloaded yet
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_14e4b9e73381999bd30ce18e65465b4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_ae48f40af0b9951cf447766eb579a598.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_02d61605059185874285443a0717cb2f.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_75e63f302ec8100b1f420af6e2de2482.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_fdcd6dd5a96083dea83816b4e5a4209e.jpg not downloaded yet
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_85a6cd43438a2b1d878fdc41ed67f543.jpg not downloaded yet
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cec90>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_28d71d759074761155af6fd7d944d857.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580c2d0>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_14e4b9e73381999bd30ce18e65465b4d.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_374108018dcfe4773a1b642a7d4a11b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_85a6cd43438a2b1d878fdc41ed67f543.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_52d2ab86081292cb1e465df5a2b1d4ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5866150>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_374108018dcfe4773a1b642a7d4a11b5.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_75e63f302ec8100b1f420af6e2de2482.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7ad0>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_85a6cd43438a2b1d878fdc41ed67f543.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1f990>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_52d2ab86081292cb1e465df5a2b1d4ce.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6010>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_75e63f302ec8100b1f420af6e2de2482.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_fdcd6dd5a96083dea83816b4e5a4209e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_02d61605059185874285443a0717cb2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d4d0>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_fdcd6dd5a96083dea83816b4e5a4209e.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_ae48f40af0b9951cf447766eb579a598.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d910>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_02d61605059185874285443a0717cb2f.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_c182485b88f3e3d6ad3693467de7e79c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696a10>
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_ae48f40af0b9951cf447766eb579a598.jpg saved to cache
2026-04-27 08:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_e88d262f278c1166f59ec6d3dd210cd4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_0fe6cbf2399a601d6ce89509e5c92e1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55298d0>
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_c182485b88f3e3d6ad3693467de7e79c.jpg saved to cache
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58142d0>
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_e88d262f278c1166f59ec6d3dd210cd4.jpg saved to cache
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594f890>
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_0fe6cbf2399a601d6ce89509e5c92e1d.jpg saved to cache
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b
2026-04-27 08:01:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f6a214c-b143-5ccc-9335-24b1eb238a6b, skipping ID generation
2026-04-27 08:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b with scrape type 1
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f6a214c-b143-5ccc-9335-24b1eb238a6b sending to next pipeline
2026-04-27 08:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f6a214c-b143-5ccc-9335-24b1eb238a6b, identifier: EP42910
2026-04-27 08:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f6a214c-b143-5ccc-9335-24b1eb238a6b with identifier: EP42910
2026-04-27 08:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f6a214c-b143-5ccc-9335-24b1eb238a6b with identifier: EP42910
2026-04-27 08:01:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f6a214c-b143-5ccc-9335-24b1eb238a6b with identifier: EP42910 to the API
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_0fe6cbf2399a601d6ce89509e5c92e1d.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Senago',
'color': 'brown',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2026-04-28T15:28:06Z',
'fuel_type': 'diesel',
'id': '8f6a214c-b143-5ccc-9335-24b1eb238a6b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EP42910',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Alfa Romeo',
'model': 'Giulia',
'odometer': 93387,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63064,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_e88d262f278c1166f59ec6d3dd210cd4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63281,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_374108018dcfe4773a1b642a7d4a11b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_0fe6cbf2399a601d6ce89509e5c92e1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56189,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_c182485b88f3e3d6ad3693467de7e79c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_52d2ab86081292cb1e465df5a2b1d4ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63477,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_ae48f40af0b9951cf447766eb579a598.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_02d61605059185874285443a0717cb2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_75e63f302ec8100b1f420af6e2de2482.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60481,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_fdcd6dd5a96083dea83816b4e5a4209e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f6a214c-b143-5ccc-9335-24b1eb238a6b/8f6a214c-b143-5ccc-9335-24b1eb238a6b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62498,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgda/cd/dacdbc94685d1a442238c7587ae769e1/pa/EP42910_85a6cd43438a2b1d878fdc41ed67f543.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2018-02-27',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Giulia 2.2 JTDM Veloce',
'transmission': 'automatic',
'trim': 'Veloce',
'year': 2018}
2026-04-27 08:01:37 [auto1.it] INFO: Saving data for EP42910: {'created_time': 1777276897.747786, 'last_price_update_time': 1777276897.747795, 'has_photos': True, 'auction_closing_time': 1777390086.0}
2026-04-27 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_b22d6ea8feb6d4e4b1e9cceec6733bcf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632a310>
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_b22d6ea8feb6d4e4b1e9cceec6733bcf.jpg saved to cache
2026-04-27 08:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_0f5c646363f992da018745aad90bedb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548ef10>
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_0f5c646363f992da018745aad90bedb2.jpg saved to cache
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_82edf4c2192e9b86a66d15af1c49a8c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_a698c97440eebab4e8a54ad0f82611f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56de5d0>
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_82edf4c2192e9b86a66d15af1c49a8c5.jpg saved to cache
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ff9d05a90080322c63d58bb9813a75a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5865410>
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_a698c97440eebab4e8a54ad0f82611f3.jpg saved to cache
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5966290>
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ff9d05a90080322c63d58bb9813a75a0.jpg saved to cache
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b
2026-04-27 08:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7b79b45-edb4-5fff-b7e9-832d02da9e3b, skipping ID generation
2026-04-27 08:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b with scrape type 1
2026-04-27 08:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7b79b45-edb4-5fff-b7e9-832d02da9e3b sending to next pipeline
2026-04-27 08:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d7b79b45-edb4-5fff-b7e9-832d02da9e3b, identifier: GY56405
2026-04-27 08:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d7b79b45-edb4-5fff-b7e9-832d02da9e3b with identifier: GY56405
2026-04-27 08:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d7b79b45-edb4-5fff-b7e9-832d02da9e3b with identifier: GY56405
2026-04-27 08:01:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d7b79b45-edb4-5fff-b7e9-832d02da9e3b with identifier: GY56405 to the API
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:01:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ff9d05a90080322c63d58bb9813a75a0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:49:42Z',
'fuel_type': 'diesel',
'id': 'd7b79b45-edb4-5fff-b7e9-832d02da9e3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY56405',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Audi',
'model': 'A3',
'odometer': 100103,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72476,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ff9d05a90080322c63d58bb9813a75a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73913,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_a698c97440eebab4e8a54ad0f82611f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64664,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_82edf4c2192e9b86a66d15af1c49a8c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59005,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_0f5c646363f992da018745aad90bedb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60126,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_b22d6ea8feb6d4e4b1e9cceec6733bcf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_14e4b9e73381999bd30ce18e65465b4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_28d71d759074761155af6fd7d944d857.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_e3c4f32f071055689d1e6b1a48927310.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_ef7dd86253937d4503c5fe59440da446.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d7b79b45-edb4-5fff-b7e9-832d02da9e3b/d7b79b45-edb4-5fff-b7e9-832d02da9e3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1b/5c/1b5cae8cf1b45dcbc13db34c24fe9620/pa/GY56405_16e3fbfd67b3b9db446f9487ce28eecf.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2016-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'Audi A3 1.6 TDI Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2016}
2026-04-27 08:01:38 [auto1.it] INFO: Saving data for GY56405: {'created_time': 1777276898.936045, 'last_price_update_time': 1777276898.936054, 'has_photos': True, 'auction_closing_time': 1777391382.0}
2026-04-27 08:01:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.889(s), this was the 2nd time calling it.
2026-04-27 08:01:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.76718798202182 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:01:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 267.157(s), this was the 2nd time calling it.
2026-04-27 08:01:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.981869011297165 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VT66321> (referer: https://www.auto1.com/v1/car-details-view/VT66321/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with identifier: VT66321
2026-04-27 08:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with scrape type 1
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_bab319f9f9e0aaad1573dc9240b55759.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_04992b1ad8dd3f893f6bd186138d3b19.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_8a62adb76a990b42c554aeb500d55992.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0aa9ee76a1ba81032f7ab18eb0a36f7c.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_3d2f8ea29301235971a2064aea12a673.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_848752656e12c49ba579e028d1113a9c.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_44b681603718db65e3679d8c019ad005.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0467329b7f28ea30db70b4032f99168c.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_75f4351f53218d7d4c5b92379c082b18.jpg not downloaded yet
2026-04-27 08:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_6a3bdd5e3e9b5322744616223237a479.jpg not downloaded yet
2026-04-27 08:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EC17055> (referer: https://www.auto1.com/v1/car-details-view/EC17055/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_6a3bdd5e3e9b5322744616223237a479.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-04-27 08:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97556c3-224c-5750-89a1-94cea337bb82 with scrape type 1
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg not downloaded yet
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_75f4351f53218d7d4c5b92379c082b18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg not downloaded yet
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580e550>
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_6a3bdd5e3e9b5322744616223237a479.jpg saved to cache
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg not downloaded yet
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg not downloaded yet
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg not downloaded yet
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55cbc50>
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_75f4351f53218d7d4c5b92379c082b18.jpg saved to cache
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg not downloaded yet
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56dc650>
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg saved to cache
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548f950>
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg saved to cache
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5866bd0>
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg saved to cache
2026-04-27 08:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548f110>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58875d0>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6477990>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5943ad0>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0110>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg saved to cache
2026-04-27 08:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568f090>
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0467329b7f28ea30db70b4032f99168c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817050>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d97556c3-224c-5750-89a1-94cea337bb82
2026-04-27 08:02:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d97556c3-224c-5750-89a1-94cea337bb82, skipping ID generation
2026-04-27 08:02:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d97556c3-224c-5750-89a1-94cea337bb82 with scrape type 1
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d97556c3-224c-5750-89a1-94cea337bb82 sending to next pipeline
2026-04-27 08:02:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d97556c3-224c-5750-89a1-94cea337bb82, identifier: EC17055
2026-04-27 08:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-04-27 08:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055
2026-04-27 08:02:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d97556c3-224c-5750-89a1-94cea337bb82 with identifier: EC17055 to the API
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 211,
'category': None,
'city': 'Varedo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:53:46Z',
'fuel_type': 'petrol',
'id': 'd97556c3-224c-5750-89a1-94cea337bb82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EC17055',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Toyota',
'model': 'RAV 4',
'odometer': 62219,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1b6fd810c039af5fd2aa628516131b0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_3c94f0ce31c7ed04a789edc30e98eac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_89753dbadc53ebb60aa93edd45299555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_c607e4670f600b6e6bf2c49ebfb76eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_1e61bbe4369e295bcb3d8f152ff1378f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_a97f727f4756bf46993cb34eb1e8c176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_72aeccf82f17c62b5e784ae8de0975d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_b09c36b33c96cdcaaa60f6e0ce623d64.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75836,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_941ec2b76180b4f31fe2bff472321894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d97556c3-224c-5750-89a1-94cea337bb82/d97556c3-224c-5750-89a1-94cea337bb82_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58205,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img20/f1/20f133ac545facfe0f2d3070a7ab7428/pa/EC17055_075581437f5b575c27c41ca7f22dbb1d.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2003-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota RAV 4 2.0 4x4',
'transmission': 'manual',
'trim': '4x4',
'year': 2003}
2026-04-27 08:02:05 [auto1.it] INFO: Saving data for EC17055: {'created_time': 1777276925.756552, 'last_price_update_time': 1777276925.756565, 'has_photos': True, 'auction_closing_time': 1777391626.0}
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_44b681603718db65e3679d8c019ad005.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6475090>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0467329b7f28ea30db70b4032f99168c.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5867d50>
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_44b681603718db65e3679d8c019ad005.jpg saved to cache
2026-04-27 08:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_848752656e12c49ba579e028d1113a9c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_3d2f8ea29301235971a2064aea12a673.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580c410>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_848752656e12c49ba579e028d1113a9c.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b9950>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_3d2f8ea29301235971a2064aea12a673.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0aa9ee76a1ba81032f7ab18eb0a36f7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cd010>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0aa9ee76a1ba81032f7ab18eb0a36f7c.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_8a62adb76a990b42c554aeb500d55992.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55ca290>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_8a62adb76a990b42c554aeb500d55992.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_04992b1ad8dd3f893f6bd186138d3b19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_bab319f9f9e0aaad1573dc9240b55759.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594e310>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_04992b1ad8dd3f893f6bd186138d3b19.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5867a50>
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_bab319f9f9e0aaad1573dc9240b55759.jpg saved to cache
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956
2026-04-27 08:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 18b90c6f-f61a-51ce-8fd0-c88ae661d956, skipping ID generation
2026-04-27 08:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with scrape type 1
2026-04-27 08:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 18b90c6f-f61a-51ce-8fd0-c88ae661d956 sending to next pipeline
2026-04-27 08:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 18b90c6f-f61a-51ce-8fd0-c88ae661d956, identifier: VT66321
2026-04-27 08:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with identifier: VT66321
2026-04-27 08:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with identifier: VT66321
2026-04-27 08:02:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 18b90c6f-f61a-51ce-8fd0-c88ae661d956 with identifier: VT66321 to the API
2026-04-27 08:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:07 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_bab319f9f9e0aaad1573dc9240b55759.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:50:52Z',
'fuel_type': 'diesel',
'id': '18b90c6f-f61a-51ce-8fd0-c88ae661d956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT66321',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'BMW',
'model': '1er',
'odometer': 116814,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74124,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_bab319f9f9e0aaad1573dc9240b55759.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_04992b1ad8dd3f893f6bd186138d3b19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_8a62adb76a990b42c554aeb500d55992.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63580,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0aa9ee76a1ba81032f7ab18eb0a36f7c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62516,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_3d2f8ea29301235971a2064aea12a673.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_848752656e12c49ba579e028d1113a9c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68052,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_44b681603718db65e3679d8c019ad005.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_0467329b7f28ea30db70b4032f99168c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_75f4351f53218d7d4c5b92379c082b18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_18b90c6f-f61a-51ce-8fd0-c88ae661d956/18b90c6f-f61a-51ce-8fd0-c88ae661d956_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1a/89/1a89dd76504c79c9f795f3470444f501/pa/VT66321_6a3bdd5e3e9b5322744616223237a479.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2014-03-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2014}
2026-04-27 08:02:07 [auto1.it] INFO: Saving data for VT66321: {'created_time': 1777276927.119535, 'last_price_update_time': 1777276927.119546, 'has_photos': True, 'auction_closing_time': 1777391452.0}
2026-04-27 08:02:10 [scrapy.extensions.logstats] INFO: Crawled 422 pages (at 14 pages/min), scraped 169 items (at 5 items/min)
2026-04-27 08:02:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HB10468> (referer: https://www.auto1.com/v1/car-details-view/HB10468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with identifier: HB10468
2026-04-27 08:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with scrape type 1
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_bda1ff1795a78ae350d5d0b917b2c682.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_734c36c2a2cf5e5b5723aafdcd06e387.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_b569de9e556abb64167b399ea6ccb98f.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_460a677c8109b98bd6b048b3873638d3.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_8e09fed5bce1cb50f0f4510b4595e69a.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f08cafb02ce8c21d7d30cb44815d90d1.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f5c34375fea65662d5b74fce357a800d.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_3c37a360a1843ca772bb4542788f391d.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_ebdff704070ef662e2954f06346cd5a3.jpg not downloaded yet
2026-04-27 08:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_7e6f783f8fefce202f4a17674dfebb0d.jpg not downloaded yet
2026-04-27 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SJ15806> (referer: https://www.auto1.com/v1/car-details-view/SJ15806/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_7e6f783f8fefce202f4a17674dfebb0d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with identifier: SJ15806
2026-04-27 08:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with scrape type 1
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_8764f5d37eba85fa712a6a9bc5cd85a3.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_765d1b3e9cb6be58460ec8f8f57864f9.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_532242e85a8f8cb13592bcbac815c3db.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_87c7b825313add583408ef2224efaca0.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_f981513bcece75c351f9da7405150eb3.jpg not downloaded yet
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c8b50>
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_7e6f783f8fefce202f4a17674dfebb0d.jpg saved to cache
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_c712e4b96c0bd3140a92a73a22412c58.jpg not downloaded yet
2026-04-27 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_ebdff704070ef662e2954f06346cd5a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_e63487a94ab3ec58b19afbb5baf887cd.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d506e527ed612ba8895450921f0c017c.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d0ca2cb27eccaac8e3ff0aabe9a3b7d6.jpg not downloaded yet
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d5fd16cfd2501ea4eef9e69d56c54f62.jpg not downloaded yet
2026-04-27 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_f981513bcece75c351f9da7405150eb3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ec150>
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_ebdff704070ef662e2954f06346cd5a3.jpg saved to cache
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696a90>
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_f981513bcece75c351f9da7405150eb3.jpg saved to cache
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d5fd16cfd2501ea4eef9e69d56c54f62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6329310>
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d5fd16cfd2501ea4eef9e69d56c54f62.jpg saved to cache
2026-04-27 08:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d0ca2cb27eccaac8e3ff0aabe9a3b7d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d506e527ed612ba8895450921f0c017c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56edf10>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d0ca2cb27eccaac8e3ff0aabe9a3b7d6.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4af70d0>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d506e527ed612ba8895450921f0c017c.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_e63487a94ab3ec58b19afbb5baf887cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_c712e4b96c0bd3140a92a73a22412c58.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5628310>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_e63487a94ab3ec58b19afbb5baf887cd.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_87c7b825313add583408ef2224efaca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594f2d0>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_c712e4b96c0bd3140a92a73a22412c58.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6482750>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_87c7b825313add583408ef2224efaca0.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_532242e85a8f8cb13592bcbac815c3db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_765d1b3e9cb6be58460ec8f8f57864f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580fe90>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_532242e85a8f8cb13592bcbac815c3db.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_8764f5d37eba85fa712a6a9bc5cd85a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0750>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_765d1b3e9cb6be58460ec8f8f57864f9.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5695d50>
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_8764f5d37eba85fa712a6a9bc5cd85a3.jpg saved to cache
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1
2026-04-27 08:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e412ebb0-9f41-56ac-a6ee-b329a953c4a1, skipping ID generation
2026-04-27 08:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with scrape type 1
2026-04-27 08:02:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e412ebb0-9f41-56ac-a6ee-b329a953c4a1 sending to next pipeline
2026-04-27 08:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e412ebb0-9f41-56ac-a6ee-b329a953c4a1, identifier: SJ15806
2026-04-27 08:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with identifier: SJ15806
2026-04-27 08:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with identifier: SJ15806
2026-04-27 08:02:14 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e412ebb0-9f41-56ac-a6ee-b329a953c4a1 with identifier: SJ15806 to the API
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_8764f5d37eba85fa712a6a9bc5cd85a3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 100,
'category': None,
'city': 'Manoppello',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:03:24Z',
'fuel_type': 'diesel',
'id': 'e412ebb0-9f41-56ac-a6ee-b329a953c4a1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 42.2592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SJ15806',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'location_confidence': 'geocoded',
'longitude': 14.0602,
'make': 'Renault',
'model': 'Scenic',
'odometer': 154952,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73299,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_8764f5d37eba85fa712a6a9bc5cd85a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_765d1b3e9cb6be58460ec8f8f57864f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_532242e85a8f8cb13592bcbac815c3db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44700,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_87c7b825313add583408ef2224efaca0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65728,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_f981513bcece75c351f9da7405150eb3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_c712e4b96c0bd3140a92a73a22412c58.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_e63487a94ab3ec58b19afbb5baf887cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d506e527ed612ba8895450921f0c017c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d0ca2cb27eccaac8e3ff0aabe9a3b7d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e412ebb0-9f41-56ac-a6ee-b329a953c4a1/e412ebb0-9f41-56ac-a6ee-b329a953c4a1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 19451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgce/a7/cea7a5ebaf2b6794d5587675a593e14e/pa/SJ15806_d5fd16cfd2501ea4eef9e69d56c54f62.jpg',
'Width': 800}],
'postal_code': '65024',
'price': 0,
'price_includes_vat': True,
'province': 'Pescara',
'province_code': 'IT-PE',
'region': 'Abruzzi',
'region_code': 'IT-01',
'registration_date': '2017-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-04-27 08:02:14 [auto1.it] INFO: Saving data for SJ15806: {'created_time': 1777276934.449802, 'last_price_update_time': 1777276934.449812, 'has_photos': True, 'auction_closing_time': 1777388604.0}
2026-04-27 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_3c37a360a1843ca772bb4542788f391d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f5c34375fea65662d5b74fce357a800d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7290>
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_3c37a360a1843ca772bb4542788f391d.jpg saved to cache
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab2890>
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f5c34375fea65662d5b74fce357a800d.jpg saved to cache
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f08cafb02ce8c21d7d30cb44815d90d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_8e09fed5bce1cb50f0f4510b4595e69a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5690>
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f08cafb02ce8c21d7d30cb44815d90d1.jpg saved to cache
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_460a677c8109b98bd6b048b3873638d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568d3d0>
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_8e09fed5bce1cb50f0f4510b4595e69a.jpg saved to cache
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552af50>
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_460a677c8109b98bd6b048b3873638d3.jpg saved to cache
2026-04-27 08:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_b569de9e556abb64167b399ea6ccb98f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_734c36c2a2cf5e5b5723aafdcd06e387.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab1e10>
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_b569de9e556abb64167b399ea6ccb98f.jpg saved to cache
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_bda1ff1795a78ae350d5d0b917b2c682.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552b4d0>
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_734c36c2a2cf5e5b5723aafdcd06e387.jpg saved to cache
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559d850>
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_bda1ff1795a78ae350d5d0b917b2c682.jpg saved to cache
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144
2026-04-27 08:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144, skipping ID generation
2026-04-27 08:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with scrape type 1
2026-04-27 08:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 sending to next pipeline
2026-04-27 08:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144, identifier: HB10468
2026-04-27 08:02:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with identifier: HB10468
2026-04-27 08:02:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with identifier: HB10468
2026-04-27 08:02:15 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fcc92c8f-eaf7-5c46-a25a-3371b5e5b144 with identifier: HB10468 to the API
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:15 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_bda1ff1795a78ae350d5d0b917b2c682.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'city': 'Roma',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:18:37Z',
'fuel_type': 'petrol',
'id': 'fcc92c8f-eaf7-5c46-a25a-3371b5e5b144',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HB10468',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Smart',
'model': 'forfour',
'odometer': 35393,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_bda1ff1795a78ae350d5d0b917b2c682.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_734c36c2a2cf5e5b5723aafdcd06e387.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52340,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_b569de9e556abb64167b399ea6ccb98f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49053,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_460a677c8109b98bd6b048b3873638d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_8e09fed5bce1cb50f0f4510b4595e69a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56597,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f08cafb02ce8c21d7d30cb44815d90d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_f5c34375fea65662d5b74fce357a800d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_3c37a360a1843ca772bb4542788f391d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58868,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_ebdff704070ef662e2954f06346cd5a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fcc92c8f-eaf7-5c46-a25a-3371b5e5b144/fcc92c8f-eaf7-5c46-a25a-3371b5e5b144_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/2b/c92b7e56a6abb651ea136eddf79cb5bf/pa/HB10468_7e6f783f8fefce202f4a17674dfebb0d.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2015-10-06',
'seats_number': 4,
'seller_name': None,
'title': 'Smart forfour 1.0 Basis passion',
'transmission': 'manual',
'trim': 'Basis passion',
'year': 2015}
2026-04-27 08:02:15 [auto1.it] INFO: Saving data for HB10468: {'created_time': 1777276935.701537, 'last_price_update_time': 1777276935.701551, 'has_photos': True, 'auction_closing_time': 1777389517.0}
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.503(s), this was the 1st time calling it.
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.959963239062471 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.842(s), this was the 1st time calling it.
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.771871653403143 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.483(s), this was the 1st time calling it.
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.808752031571478 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.484(s), this was the 1st time calling it.
2026-04-27 08:02:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.7886249519942305 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RF33119/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BD69591> (referer: https://www.auto1.com/v1/car-details-view/BD69591/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd87578-01f4-546a-b7c1-d18eef96d2f4 with identifier: BD69591
2026-04-27 08:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd87578-01f4-546a-b7c1-d18eef96d2f4 with scrape type 1
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_749e0cb8f0c75f7f3031befb78fa5546.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_f5493c3206bf0600a3bc0c775f47fbfc.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_be014e4fface63797b1bd69cc6f72c0a.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_719f1ccdc35c73c015d1977e0e391da2.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_934d44e9c32bef274cad5b22201ba3f0.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_89c38d48318300e01f56b994862cb19f.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3f0c71dc5db8c854fea7e5f01e20bab0.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_108f1ac0c7e67962cba9cfaa84c53042.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3c190b338198794e0ce4f07e58fd8737.jpg not downloaded yet
2026-04-27 08:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_d5350d06e1a3ec5d568fb427ec6dec84.jpg not downloaded yet
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EU61805> (referer: https://www.auto1.com/v1/car-details-view/EU61805/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_d5350d06e1a3ec5d568fb427ec6dec84.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VZ92626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb1ee526-9100-501e-8d13-c0a0aec75e75 with identifier: EU61805
2026-04-27 08:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb1ee526-9100-501e-8d13-c0a0aec75e75 with scrape type 1
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_c5a682eff8312217b94037bc75339b76.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_55d0ba60aa07f88b4303098a8ffa1258.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_b18050f816b38425cb7587f5d339d6c4.jpg not downloaded yet
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3c190b338198794e0ce4f07e58fd8737.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_0cf8f5e4d36e6b9394b7278c30f4f624.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_76c99bbf146363232bd72292b11ef55c.jpg not downloaded yet
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b910>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_d5350d06e1a3ec5d568fb427ec6dec84.jpg saved to cache
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_b18050f816b38425cb7587f5d339d6c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XP72573> (referer: https://www.auto1.com/v1/car-details-view/XP72573/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550c2d0>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3c190b338198794e0ce4f07e58fd8737.jpg saved to cache
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_108f1ac0c7e67962cba9cfaa84c53042.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e0850>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_b18050f816b38425cb7587f5d339d6c4.jpg saved to cache
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_76c99bbf146363232bd72292b11ef55c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66d20f06-6435-50fa-a801-9965b41ad2e1 with identifier: XP72573
2026-04-27 08:02:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d20f06-6435-50fa-a801-9965b41ad2e1 with scrape type 1
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_b28036bb8d3e9b8d5bb2bbe3fdb13fc0.jpg not downloaded yet
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a78d0>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_108f1ac0c7e67962cba9cfaa84c53042.jpg saved to cache
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_5668fff98dc467e12c248781b13b6b8d.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_3cfbe726894b08d10f3d93bc54db82c2.jpg not downloaded yet
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_55d0ba60aa07f88b4303098a8ffa1258.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_81a2b0e9e85bb093e0918a5b38b52263.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_67fbbdfcf687911cb8890ab94369e725.jpg not downloaded yet
2026-04-27 08:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_0cf8f5e4d36e6b9394b7278c30f4f624.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_8c33e155e7017a2715de22ad91379f5b.jpg not downloaded yet
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a89310>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_76c99bbf146363232bd72292b11ef55c.jpg saved to cache
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_844a810ad3dce9398b995eb39bcd39fd.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_62124efcc390b9deafd2e4a0b1389d62.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_e204b59bf356ebdb3e8f8d55c8408e59.jpg not downloaded yet
2026-04-27 08:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_48791ff5952ae51785774389f2d3bc3b.jpg not downloaded yet
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56de8d0>
2026-04-27 08:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_55d0ba60aa07f88b4303098a8ffa1258.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593d390>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_0cf8f5e4d36e6b9394b7278c30f4f624.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_3cfbe726894b08d10f3d93bc54db82c2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_67fbbdfcf687911cb8890ab94369e725.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bc310>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_3cfbe726894b08d10f3d93bc54db82c2.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_e204b59bf356ebdb3e8f8d55c8408e59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83cd7d0>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_67fbbdfcf687911cb8890ab94369e725.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_48791ff5952ae51785774389f2d3bc3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bc450>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_e204b59bf356ebdb3e8f8d55c8408e59.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YB68272> (referer: https://www.auto1.com/v1/car-details-view/YB68272/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a5a10>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_48791ff5952ae51785774389f2d3bc3b.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_62124efcc390b9deafd2e4a0b1389d62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d489e464-ec90-5947-833c-698061b9096d with identifier: YB68272
2026-04-27 08:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d489e464-ec90-5947-833c-698061b9096d with scrape type 1
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_7173deeae6c8eb35952a15efba3a13c1.jpg not downloaded yet
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_844a810ad3dce9398b995eb39bcd39fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_12574d35f6212418139e7dbe126c393a.jpg not downloaded yet
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_5a37a0e36e9d27fc7dbeca6c5780ab49.jpg not downloaded yet
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_dfddbf6e4c358a9ea74e96781a1845b3.jpg not downloaded yet
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bc450>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_62124efcc390b9deafd2e4a0b1389d62.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_253da1293cd65d765a637f9bbdc9a633.jpg not downloaded yet
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_81a2b0e9e85bb093e0918a5b38b52263.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769550>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_844a810ad3dce9398b995eb39bcd39fd.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_8c33e155e7017a2715de22ad91379f5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_7173deeae6c8eb35952a15efba3a13c1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5528950>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_81a2b0e9e85bb093e0918a5b38b52263.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_dfddbf6e4c358a9ea74e96781a1845b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_5a37a0e36e9d27fc7dbeca6c5780ab49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5456310>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_8c33e155e7017a2715de22ad91379f5b.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d6b90>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_7173deeae6c8eb35952a15efba3a13c1.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_253da1293cd65d765a637f9bbdc9a633.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_5668fff98dc467e12c248781b13b6b8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a690>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_dfddbf6e4c358a9ea74e96781a1845b3.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57fb690>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_5a37a0e36e9d27fc7dbeca6c5780ab49.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_b28036bb8d3e9b8d5bb2bbe3fdb13fc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_c5a682eff8312217b94037bc75339b76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785390>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_253da1293cd65d765a637f9bbdc9a633.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead593d9d0>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_5668fff98dc467e12c248781b13b6b8d.jpg saved to cache
2026-04-27 08:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_12574d35f6212418139e7dbe126c393a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3f0c71dc5db8c854fea7e5f01e20bab0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_89c38d48318300e01f56b994862cb19f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552b810>
2026-04-27 08:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_b28036bb8d3e9b8d5bb2bbe3fdb13fc0.jpg saved to cache
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 66d20f06-6435-50fa-a801-9965b41ad2e1
2026-04-27 08:02:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 66d20f06-6435-50fa-a801-9965b41ad2e1, skipping ID generation
2026-04-27 08:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66d20f06-6435-50fa-a801-9965b41ad2e1 with scrape type 1
2026-04-27 08:02:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 66d20f06-6435-50fa-a801-9965b41ad2e1 sending to next pipeline
2026-04-27 08:02:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 66d20f06-6435-50fa-a801-9965b41ad2e1, identifier: XP72573
2026-04-27 08:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 66d20f06-6435-50fa-a801-9965b41ad2e1 with identifier: XP72573
2026-04-27 08:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 66d20f06-6435-50fa-a801-9965b41ad2e1 with identifier: XP72573
2026-04-27 08:02:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 66d20f06-6435-50fa-a801-9965b41ad2e1 with identifier: XP72573 to the API
2026-04-27 08:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_b28036bb8d3e9b8d5bb2bbe3fdb13fc0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Senago',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-04-28T15:17:42Z',
'fuel_type': 'hybrid',
'id': '66d20f06-6435-50fa-a801-9965b41ad2e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XP72573',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Hyundai',
'model': 'Kona',
'odometer': 68028,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77084,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_b28036bb8d3e9b8d5bb2bbe3fdb13fc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77084,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_5668fff98dc467e12c248781b13b6b8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71224,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_3cfbe726894b08d10f3d93bc54db82c2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72395,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_81a2b0e9e85bb093e0918a5b38b52263.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68226,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_67fbbdfcf687911cb8890ab94369e725.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78930,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_8c33e155e7017a2715de22ad91379f5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70663,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_844a810ad3dce9398b995eb39bcd39fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72875,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_62124efcc390b9deafd2e4a0b1389d62.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76105,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_e204b59bf356ebdb3e8f8d55c8408e59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_66d20f06-6435-50fa-a801-9965b41ad2e1/66d20f06-6435-50fa-a801-9965b41ad2e1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41985,
'Height': 533,
'OriginUrl': 'https://img-pa.auto1.com/img5a/ae/5aaeb5f83d86b7f1d461d94772c81ead/pa/XP72573_48791ff5952ae51785774389f2d3bc3b.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2022-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Kona 1.6 Hybrid XTech+ 2WD',
'transmission': 'automatic',
'trim': 'XTech+ 2WD',
'year': 2022}
2026-04-27 08:02:57 [auto1.it] INFO: Saving data for XP72573: {'created_time': 1777276977.688088, 'last_price_update_time': 1777276977.688107, 'has_photos': True, 'auction_closing_time': 1777389462.0}
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784950>
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_c5a682eff8312217b94037bc75339b76.jpg saved to cache
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb1ee526-9100-501e-8d13-c0a0aec75e75
2026-04-27 08:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb1ee526-9100-501e-8d13-c0a0aec75e75, skipping ID generation
2026-04-27 08:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb1ee526-9100-501e-8d13-c0a0aec75e75 with scrape type 1
2026-04-27 08:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb1ee526-9100-501e-8d13-c0a0aec75e75 sending to next pipeline
2026-04-27 08:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fb1ee526-9100-501e-8d13-c0a0aec75e75, identifier: EU61805
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_719f1ccdc35c73c015d1977e0e391da2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_be014e4fface63797b1bd69cc6f72c0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_934d44e9c32bef274cad5b22201ba3f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD11535/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN50903> (referer: https://www.auto1.com/v1/car-details-view/HN50903/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BN85160/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fb1ee526-9100-501e-8d13-c0a0aec75e75 with identifier: EU61805
2026-04-27 08:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fb1ee526-9100-501e-8d13-c0a0aec75e75 with identifier: EU61805
2026-04-27 08:02:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fb1ee526-9100-501e-8d13-c0a0aec75e75 with identifier: EU61805 to the API
2026-04-27 08:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_c5a682eff8312217b94037bc75339b76.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'category': None,
'city': 'Latina',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:42:17Z',
'fuel_type': 'petrol',
'id': 'fb1ee526-9100-501e-8d13-c0a0aec75e75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.4661,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU61805',
'listing': 'auction',
'location': 'IT, Latina',
'location_confidence': 'geocoded',
'longitude': 12.9043,
'make': 'Ford',
'model': 'Fiesta',
'odometer': 201868,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121164,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_c5a682eff8312217b94037bc75339b76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_55d0ba60aa07f88b4303098a8ffa1258.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_b18050f816b38425cb7587f5d339d6c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_0cf8f5e4d36e6b9394b7278c30f4f624.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fb1ee526-9100-501e-8d13-c0a0aec75e75/fb1ee526-9100-501e-8d13-c0a0aec75e75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87637,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/88/37882ea5fc7d19b9f9756e770d701c77/pa/EU61805_76c99bbf146363232bd72292b11ef55c.jpg',
'Width': 800}],
'postal_code': '04100',
'price': 0,
'price_includes_vat': True,
'province': 'Latina',
'province_code': 'IT-LT',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2012-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Fiesta 1.25 Trend',
'transmission': 'manual',
'trim': 'Trend',
'year': 2012}
2026-04-27 08:02:58 [auto1.it] INFO: Saving data for EU61805: {'created_time': 1777276978.171272, 'last_price_update_time': 1777276978.171285, 'has_photos': True, 'auction_closing_time': 1777390937.0}
2026-04-27 08:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696610>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_12574d35f6212418139e7dbe126c393a.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d489e464-ec90-5947-833c-698061b9096d
2026-04-27 08:02:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d489e464-ec90-5947-833c-698061b9096d, skipping ID generation
2026-04-27 08:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d489e464-ec90-5947-833c-698061b9096d with scrape type 1
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d489e464-ec90-5947-833c-698061b9096d sending to next pipeline
2026-04-27 08:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d489e464-ec90-5947-833c-698061b9096d, identifier: YB68272
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cc210>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3f0c71dc5db8c854fea7e5f01e20bab0.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5454610>
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_89c38d48318300e01f56b994862cb19f.jpg saved to cache
2026-04-27 08:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d489e464-ec90-5947-833c-698061b9096d with identifier: YB68272
2026-04-27 08:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d489e464-ec90-5947-833c-698061b9096d with identifier: YB68272
2026-04-27 08:02:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d489e464-ec90-5947-833c-698061b9096d with identifier: YB68272 to the API
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_12574d35f6212418139e7dbe126c393a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO N\\/A',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:21:26Z',
'fuel_type': 'diesel',
'id': 'd489e464-ec90-5947-833c-698061b9096d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB68272',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Opel',
'model': 'Astra',
'odometer': 169214,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_7173deeae6c8eb35952a15efba3a13c1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83635,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_12574d35f6212418139e7dbe126c393a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_5a37a0e36e9d27fc7dbeca6c5780ab49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_dfddbf6e4c358a9ea74e96781a1845b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d489e464-ec90-5947-833c-698061b9096d/d489e464-ec90-5947-833c-698061b9096d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img72/24/7224004616c37ce252e599570280b8b1/pa/YB68272_253da1293cd65d765a637f9bbdc9a633.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2015-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.6 CDTI DPF Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2015}
2026-04-27 08:02:58 [auto1.it] INFO: Saving data for YB68272: {'created_time': 1777276978.902258, 'last_price_update_time': 1777276978.90227, 'has_photos': True, 'auction_closing_time': 1777389686.0}
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5697fd0>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_719f1ccdc35c73c015d1977e0e391da2.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6474e50>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_be014e4fface63797b1bd69cc6f72c0a.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6329cd0>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_934d44e9c32bef274cad5b22201ba3f0.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f62b121-1a50-5afe-9122-c772d5befb13 with identifier: HN50903
2026-04-27 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f62b121-1a50-5afe-9122-c772d5befb13 with scrape type 1
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b08ae14190c622478bcc2ef9c2fab842.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8c32184937c0aefbf73489641414c50c.jpg not downloaded yet
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_f5493c3206bf0600a3bc0c775f47fbfc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_749e0cb8f0c75f7f3031befb78fa5546.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_92740dd85564e18eee58fb21999b10af.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b02927bd297df9ea3171fc31d764aca7.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_ed8aa0d277785ccce4969083761d270e.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_7cf6841020fceb2a600b1e327df01fa6.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8fe79f7478481b9aab7c01ea657a6612.jpg not downloaded yet
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_a6d26634d3deebedcbce6970bd6fe051.jpg not downloaded yet
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b08ae14190c622478bcc2ef9c2fab842.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_22033270fc1409d47ea0da8c8bedb078.jpg not downloaded yet
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0f8d0>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_f5493c3206bf0600a3bc0c775f47fbfc.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_0c3c5eb731d8e1075931b12388725f45.jpg not downloaded yet
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566d6d0>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_749e0cb8f0c75f7f3031befb78fa5546.jpg saved to cache
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efd87578-01f4-546a-b7c1-d18eef96d2f4
2026-04-27 08:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efd87578-01f4-546a-b7c1-d18eef96d2f4, skipping ID generation
2026-04-27 08:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd87578-01f4-546a-b7c1-d18eef96d2f4 with scrape type 1
2026-04-27 08:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efd87578-01f4-546a-b7c1-d18eef96d2f4 sending to next pipeline
2026-04-27 08:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efd87578-01f4-546a-b7c1-d18eef96d2f4, identifier: BD69591
2026-04-27 08:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efd87578-01f4-546a-b7c1-d18eef96d2f4 with identifier: BD69591
2026-04-27 08:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efd87578-01f4-546a-b7c1-d18eef96d2f4 with identifier: BD69591
2026-04-27 08:02:59 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efd87578-01f4-546a-b7c1-d18eef96d2f4 with identifier: BD69591 to the API
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_749e0cb8f0c75f7f3031befb78fa5546.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:51:58Z',
'fuel_type': 'diesel',
'id': 'efd87578-01f4-546a-b7c1-d18eef96d2f4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD69591',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 181595,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_749e0cb8f0c75f7f3031befb78fa5546.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101683,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_f5493c3206bf0600a3bc0c775f47fbfc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_be014e4fface63797b1bd69cc6f72c0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_719f1ccdc35c73c015d1977e0e391da2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84740,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_934d44e9c32bef274cad5b22201ba3f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_89c38d48318300e01f56b994862cb19f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3f0c71dc5db8c854fea7e5f01e20bab0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_108f1ac0c7e67962cba9cfaa84c53042.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_3c190b338198794e0ce4f07e58fd8737.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efd87578-01f4-546a-b7c1-d18eef96d2f4/efd87578-01f4-546a-b7c1-d18eef96d2f4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/9f/819f384ee5ee7466b92252111b288d7f/pa/BD69591_d5350d06e1a3ec5d568fb427ec6dec84.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-04-10',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
'transmission': 'automatic',
'trim': 'SE Dynamic',
'year': 2016}
2026-04-27 08:02:59 [auto1.it] INFO: Saving data for BD69591: {'created_time': 1777276979.960703, 'last_price_update_time': 1777276979.960713, 'has_photos': True, 'auction_closing_time': 1777391518.0}
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_a6d26634d3deebedcbce6970bd6fe051.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ76362/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:02:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf27720d0>
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:02:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b08ae14190c622478bcc2ef9c2fab842.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c2090>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_a6d26634d3deebedcbce6970bd6fe051.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_0c3c5eb731d8e1075931b12388725f45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_22033270fc1409d47ea0da8c8bedb078.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64089d0>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_0c3c5eb731d8e1075931b12388725f45.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5952ad0>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_22033270fc1409d47ea0da8c8bedb078.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8fe79f7478481b9aab7c01ea657a6612.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589d650>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8fe79f7478481b9aab7c01ea657a6612.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_7cf6841020fceb2a600b1e327df01fa6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WZ30101/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6363a50>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_7cf6841020fceb2a600b1e327df01fa6.jpg saved to cache
2026-04-27 08:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_ed8aa0d277785ccce4969083761d270e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b02927bd297df9ea3171fc31d764aca7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5582390>
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_ed8aa0d277785ccce4969083761d270e.jpg saved to cache
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580d450>
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b02927bd297df9ea3171fc31d764aca7.jpg saved to cache
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_92740dd85564e18eee58fb21999b10af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587a010>
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_92740dd85564e18eee58fb21999b10af.jpg saved to cache
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8c32184937c0aefbf73489641414c50c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BT13926> (referer: https://www.auto1.com/v1/car-details-view/BT13926/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63609d0>
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8c32184937c0aefbf73489641414c50c.jpg saved to cache
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f62b121-1a50-5afe-9122-c772d5befb13
2026-04-27 08:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f62b121-1a50-5afe-9122-c772d5befb13, skipping ID generation
2026-04-27 08:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f62b121-1a50-5afe-9122-c772d5befb13 with scrape type 1
2026-04-27 08:03:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f62b121-1a50-5afe-9122-c772d5befb13 sending to next pipeline
2026-04-27 08:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f62b121-1a50-5afe-9122-c772d5befb13, identifier: HN50903
2026-04-27 08:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f62b121-1a50-5afe-9122-c772d5befb13 with identifier: HN50903
2026-04-27 08:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f62b121-1a50-5afe-9122-c772d5befb13 with identifier: HN50903
2026-04-27 08:03:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f62b121-1a50-5afe-9122-c772d5befb13 with identifier: HN50903 to the API
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8c32184937c0aefbf73489641414c50c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 138,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:12:44Z',
'fuel_type': 'diesel',
'id': '7f62b121-1a50-5afe-9122-c772d5befb13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN50903',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Ford',
'model': 'S-Max',
'odometer': 166731,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b08ae14190c622478bcc2ef9c2fab842.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8c32184937c0aefbf73489641414c50c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_92740dd85564e18eee58fb21999b10af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_b02927bd297df9ea3171fc31d764aca7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_ed8aa0d277785ccce4969083761d270e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_7cf6841020fceb2a600b1e327df01fa6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69706,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_8fe79f7478481b9aab7c01ea657a6612.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_a6d26634d3deebedcbce6970bd6fe051.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_22033270fc1409d47ea0da8c8bedb078.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f62b121-1a50-5afe-9122-c772d5befb13/7f62b121-1a50-5afe-9122-c772d5befb13_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/0d/ad0dca41d1f4c7ec3f578e174163e68d/pa/HN50903_0c3c5eb731d8e1075931b12388725f45.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-12-22',
'seats_number': 5,
'seller_name': None,
'title': 'Ford S-Max 2.0 TDCi EcoBlue Titanium Business',
'transmission': 'automatic',
'trim': 'Titanium Business',
'year': 2019}
2026-04-27 08:03:02 [auto1.it] INFO: Saving data for HN50903: {'created_time': 1777276982.03348, 'last_price_update_time': 1777276982.033491, 'has_photos': True, 'auction_closing_time': 1777389164.0}
2026-04-27 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_f572c9927dde5bd75896450c916986fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-04-27 08:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec49e752-eb4e-520f-bcc4-2192930184ac with scrape type 1
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg not downloaded yet
2026-04-27 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5b057478f0f59291921c49edcaa3043e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg not downloaded yet
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6335550>
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_f572c9927dde5bd75896450c916986fc.jpg saved to cache
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg not downloaded yet
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg not downloaded yet
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a98390>
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5b057478f0f59291921c49edcaa3043e.jpg saved to cache
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560e350>
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg saved to cache
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567aed0>
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg saved to cache
2026-04-27 08:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ae910>
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6361e10>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a98b90>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RF33119> (referer: https://www.auto1.com/v1/car-details-view/RF33119/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GT34435/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92659a5f-5b8f-596e-959a-68364c035173 with identifier: RF33119
2026-04-27 08:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92659a5f-5b8f-596e-959a-68364c035173 with scrape type 1
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_eb2eff61615c5a8c28e1a2498dd04b9b.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_b981e643957b4fe703bee3c568d40c8f.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_d872db0773363724dec13f4c15242c4e.jpg not downloaded yet
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5583290>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_57063ea56eaf32095448bc790a7058b7.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_1471d571fa5619c7d8e502a1e2e70c40.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_6e1f79a59d8252e44ecdd824c77f80cf.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e6b56f7171f2576d2ffdd979220c2145.jpg not downloaded yet
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_3dafba994bfa585b80721bc062a83726.jpg not downloaded yet
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e4a8a053143a3915a8ccf836502da2d3.jpg not downloaded yet
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_a28407ae31a1fafd457de560418a41c5.jpg not downloaded yet
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5583210>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5679110>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg saved to cache
2026-04-27 08:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_3dafba994bfa585b80721bc062a83726.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e6b56f7171f2576d2ffdd979220c2145.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587d390>
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50810>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_3dafba994bfa585b80721bc062a83726.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_a28407ae31a1fafd457de560418a41c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9a110>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e6b56f7171f2576d2ffdd979220c2145.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e4a8a053143a3915a8ccf836502da2d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5493910>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_a28407ae31a1fafd457de560418a41c5.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_6e1f79a59d8252e44ecdd824c77f80cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5582190>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e4a8a053143a3915a8ccf836502da2d3.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_1471d571fa5619c7d8e502a1e2e70c40.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a1150>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_6e1f79a59d8252e44ecdd824c77f80cf.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_57063ea56eaf32095448bc790a7058b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589e510>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_1471d571fa5619c7d8e502a1e2e70c40.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c3b90>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_57063ea56eaf32095448bc790a7058b7.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_b981e643957b4fe703bee3c568d40c8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_d872db0773363724dec13f4c15242c4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_eb2eff61615c5a8c28e1a2498dd04b9b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55816d0>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_b981e643957b4fe703bee3c568d40c8f.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52090>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_d872db0773363724dec13f4c15242c4e.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_fcdbb43b4b63edb8a6a4598202d1bf4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5879390>
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_eb2eff61615c5a8c28e1a2498dd04b9b.jpg saved to cache
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 92659a5f-5b8f-596e-959a-68364c035173
2026-04-27 08:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 92659a5f-5b8f-596e-959a-68364c035173, skipping ID generation
2026-04-27 08:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92659a5f-5b8f-596e-959a-68364c035173 with scrape type 1
2026-04-27 08:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 92659a5f-5b8f-596e-959a-68364c035173 sending to next pipeline
2026-04-27 08:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 92659a5f-5b8f-596e-959a-68364c035173, identifier: RF33119
2026-04-27 08:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 92659a5f-5b8f-596e-959a-68364c035173 with identifier: RF33119
2026-04-27 08:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 92659a5f-5b8f-596e-959a-68364c035173 with identifier: RF33119
2026-04-27 08:03:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 92659a5f-5b8f-596e-959a-68364c035173 with identifier: RF33119 to the API
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_eb2eff61615c5a8c28e1a2498dd04b9b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'city': 'Varedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:14:35Z',
'fuel_type': 'petrol',
'id': '92659a5f-5b8f-596e-959a-68364c035173',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF33119',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Volkswagen',
'model': 'Polo',
'odometer': 114117,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_eb2eff61615c5a8c28e1a2498dd04b9b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_b981e643957b4fe703bee3c568d40c8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_d872db0773363724dec13f4c15242c4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_57063ea56eaf32095448bc790a7058b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_1471d571fa5619c7d8e502a1e2e70c40.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_6e1f79a59d8252e44ecdd824c77f80cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e6b56f7171f2576d2ffdd979220c2145.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_3dafba994bfa585b80721bc062a83726.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_e4a8a053143a3915a8ccf836502da2d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_92659a5f-5b8f-596e-959a-68364c035173/92659a5f-5b8f-596e-959a-68364c035173_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img58/87/5887439abc66765c032bd6b65c6dde9f/pa/RF33119_a28407ae31a1fafd457de560418a41c5.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Polo 1.0 Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2016}
2026-04-27 08:03:05 [auto1.it] INFO: Saving data for RF33119: {'created_time': 1777276985.366301, 'last_price_update_time': 1777276985.366311, 'has_photos': True, 'auction_closing_time': 1777389275.0}
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5878910>
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg saved to cache
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec49e752-eb4e-520f-bcc4-2192930184ac
2026-04-27 08:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec49e752-eb4e-520f-bcc4-2192930184ac, skipping ID generation
2026-04-27 08:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec49e752-eb4e-520f-bcc4-2192930184ac with scrape type 1
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec49e752-eb4e-520f-bcc4-2192930184ac sending to next pipeline
2026-04-27 08:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ec49e752-eb4e-520f-bcc4-2192930184ac, identifier: BT13926
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58dbe10>
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_fcdbb43b4b63edb8a6a4598202d1bf4d.jpg saved to cache
2026-04-27 08:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-04-27 08:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926
2026-04-27 08:03:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ec49e752-eb4e-520f-bcc4-2192930184ac with identifier: BT13926 to the API
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 26,
'category': None,
'city': 'Milazzo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 224,
'expiration_date': '2026-04-28T15:20:26Z',
'fuel_type': 'hybrid',
'id': 'ec49e752-eb4e-520f-bcc4-2192930184ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BT13926',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Ford',
'model': 'Kuga',
'odometer': 57408,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_11cdf448b9cbd5a28add34d15112d53f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_40f37b910463e100a53a5a33c4a54cdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111067,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_e8ecc9d3cb3fd90f394994a82781de79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_0a124c7549a8029b478d6739a76ec7cd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d48603d7bfb4590b5d2d29e0fc25a0b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107697,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_7aa8f15bc6ca1d9d16601b39d08c2963.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_8c493201903734796c9bdb1623190db6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_dd0351c6b62849798a2be9966df9f769.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104063,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_72695348874e260c424a0f86bb289bbb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ec49e752-eb4e-520f-bcc4-2192930184ac/ec49e752-eb4e-520f-bcc4-2192930184ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/53/e553ee6dd36757db2a072d7fcbfa45ec/pa/BT13926_d2887e03ec577f14ca2603f69ddaf081.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2020-02-23',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.5 Plug-in Hybrid ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2020}
2026-04-27 08:03:05 [auto1.it] INFO: Saving data for BT13926: {'created_time': 1777276985.888883, 'last_price_update_time': 1777276985.888895, 'has_photos': True, 'auction_closing_time': 1777389626.0}
2026-04-27 08:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XB11924/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY26414/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c6110>
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg saved to cache
2026-04-27 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b6bf45df4d37abeca8230b7093c09a4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59513d0>
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b6bf45df4d37abeca8230b7093c09a4e.jpg saved to cache
2026-04-27 08:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:10 [scrapy.extensions.logstats] INFO: Crawled 440 pages (at 18 pages/min), scraped 178 items (at 9 items/min)
2026-04-27 08:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE51399/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP12220/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_005502ce7fa29afa09aa47cd3c4d96ba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead566f0d0>
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_005502ce7fa29afa09aa47cd3c4d96ba.jpg saved to cache
2026-04-27 08:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WZ30101> (referer: https://www.auto1.com/v1/car-details-view/WZ30101/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f63c4c4-bca9-56e2-a9a5-a17727364728 with identifier: WZ30101
2026-04-27 08:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f63c4c4-bca9-56e2-a9a5-a17727364728 with scrape type 1
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_6d1e50fba23ec57c4d862c285fe72b23.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_06192695905ad13d2bbacc37cb4e58d4.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7cfce80f053731cb1e6a26b90a56b70e.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_d2fd61bde3b6265fb227c19245d5736d.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_50a43c2b612613cb8310613e1c5d57f0.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_8fec97d28da69d60c3210fce3f0cb55a.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_0eb6327f65860554e829cb283e7cc9d1.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7f6530df34e876bde5a86f59dff2e369.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_fbfe8e176ed9a092c6138ca3d6303c01.jpg not downloaded yet
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_49afb886abfb2a10f34eb59e1e48f557.jpg not downloaded yet
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YU29433/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_49afb886abfb2a10f34eb59e1e48f557.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560db90>
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_49afb886abfb2a10f34eb59e1e48f557.jpg saved to cache
2026-04-27 08:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GT34435> (referer: https://www.auto1.com/v1/car-details-view/GT34435/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_fbfe8e176ed9a092c6138ca3d6303c01.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-04-27 08:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c63319-e6ee-57b2-a13a-bf92adc38d63 with scrape type 1
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_e9c4e8463a4e4e56e5bba75ff8d0b058.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_655385091c16927f09cdc2999ee82473.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_c9f5a2664863b1065d6df51cc7bfd004.jpg not downloaded yet
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7f6530df34e876bde5a86f59dff2e369.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_928b5ae7a5579be50b6369546abfa8c6.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_b96d952b89b2e1f8df955f42cfc51fac.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_ac74efa087712855124e5660c0abba4e.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_9bcc84967058242176ce348d6873b31f.jpg not downloaded yet
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57f6190>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_fbfe8e176ed9a092c6138ca3d6303c01.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_6e9deca1e635d8bb98d9009d41e75d80.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_5301602b31483c26543a126b65f156ff.jpg not downloaded yet
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_baed03716a3f36ee5c378bc91dc5a97e.jpg not downloaded yet
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a90450>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7f6530df34e876bde5a86f59dff2e369.jpg saved to cache
2026-04-27 08:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_c9f5a2664863b1065d6df51cc7bfd004.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56909d0>
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_c9f5a2664863b1065d6df51cc7bfd004.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_baed03716a3f36ee5c378bc91dc5a97e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a3e50>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_baed03716a3f36ee5c378bc91dc5a97e.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_5301602b31483c26543a126b65f156ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5959090>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_5301602b31483c26543a126b65f156ff.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_6e9deca1e635d8bb98d9009d41e75d80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56909d0>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_6e9deca1e635d8bb98d9009d41e75d80.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_9bcc84967058242176ce348d6873b31f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587a3d0>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_9bcc84967058242176ce348d6873b31f.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_ac74efa087712855124e5660c0abba4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632b6d0>
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_ac74efa087712855124e5660c0abba4e.jpg saved to cache
2026-04-27 08:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_b96d952b89b2e1f8df955f42cfc51fac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD11535> (referer: https://www.auto1.com/v1/car-details-view/JD11535/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5654f90>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_b96d952b89b2e1f8df955f42cfc51fac.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e3e970a-c898-58f9-9c75-dfe743df46e2 with identifier: JD11535
2026-04-27 08:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e3e970a-c898-58f9-9c75-dfe743df46e2 with scrape type 1
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_54481aaa1c9ad708f066a19fffe0bcb6.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_5d73a4cee08a21ea98bc6be882bd7113.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_e97942f11e97facb7e541fea81842473.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_efaabc9e6577f23d483bd160b68499c6.jpg not downloaded yet
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_928b5ae7a5579be50b6369546abfa8c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_26515ab0e53399e145a7f2672414f187.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_64d0af26e6628642ef674d9866b70d52.jpg not downloaded yet
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_655385091c16927f09cdc2999ee82473.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_618c3cb507422272fc68954c932e8837.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_627aca7409f77cd89c2ed24d2c8f5df2.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_19cb1903bed017e2a3d5eb60a877a7ce.jpg not downloaded yet
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_50c832611a370e74419799241358b716.jpg not downloaded yet
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56db310>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_928b5ae7a5579be50b6369546abfa8c6.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c4410>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_655385091c16927f09cdc2999ee82473.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_efaabc9e6577f23d483bd160b68499c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_64d0af26e6628642ef674d9866b70d52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5396390>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_efaabc9e6577f23d483bd160b68499c6.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TD68261/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59ae8d0>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_64d0af26e6628642ef674d9866b70d52.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_19cb1903bed017e2a3d5eb60a877a7ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_50c832611a370e74419799241358b716.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead560f750>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_19cb1903bed017e2a3d5eb60a877a7ce.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533cf90>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_50c832611a370e74419799241358b716.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_627aca7409f77cd89c2ed24d2c8f5df2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_26515ab0e53399e145a7f2672414f187.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_618c3cb507422272fc68954c932e8837.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZC15371/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567b4d0>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_627aca7409f77cd89c2ed24d2c8f5df2.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6361a10>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_26515ab0e53399e145a7f2672414f187.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5752510>
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_618c3cb507422272fc68954c932e8837.jpg saved to cache
2026-04-27 08:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_5d73a4cee08a21ea98bc6be882bd7113.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_54481aaa1c9ad708f066a19fffe0bcb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_e97942f11e97facb7e541fea81842473.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_e9c4e8463a4e4e56e5bba75ff8d0b058.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a53f10>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_5d73a4cee08a21ea98bc6be882bd7113.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55827d0>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_54481aaa1c9ad708f066a19fffe0bcb6.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63284d0>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_e97942f11e97facb7e541fea81842473.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e3e970a-c898-58f9-9c75-dfe743df46e2
2026-04-27 08:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e3e970a-c898-58f9-9c75-dfe743df46e2, skipping ID generation
2026-04-27 08:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e3e970a-c898-58f9-9c75-dfe743df46e2 with scrape type 1
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e3e970a-c898-58f9-9c75-dfe743df46e2 sending to next pipeline
2026-04-27 08:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8e3e970a-c898-58f9-9c75-dfe743df46e2, identifier: JD11535
2026-04-27 08:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8e3e970a-c898-58f9-9c75-dfe743df46e2 with identifier: JD11535
2026-04-27 08:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8e3e970a-c898-58f9-9c75-dfe743df46e2 with identifier: JD11535
2026-04-27 08:03:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8e3e970a-c898-58f9-9c75-dfe743df46e2 with identifier: JD11535 to the API
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_e97942f11e97facb7e541fea81842473.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 179,
'expiration_date': '2026-04-28T15:19:34Z',
'fuel_type': 'diesel',
'id': '8e3e970a-c898-58f9-9c75-dfe743df46e2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD11535',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 96958,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65571,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_54481aaa1c9ad708f066a19fffe0bcb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_5d73a4cee08a21ea98bc6be882bd7113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65965,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_e97942f11e97facb7e541fea81842473.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_efaabc9e6577f23d483bd160b68499c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_26515ab0e53399e145a7f2672414f187.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_64d0af26e6628642ef674d9866b70d52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_618c3cb507422272fc68954c932e8837.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62519,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_627aca7409f77cd89c2ed24d2c8f5df2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_19cb1903bed017e2a3d5eb60a877a7ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8e3e970a-c898-58f9-9c75-dfe743df46e2/8e3e970a-c898-58f9-9c75-dfe743df46e2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/f6/eaf6057424bdcbbed155379636877aaa/pa/JD11535_50c832611a370e74419799241358b716.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2019-09-17',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport D180 R-Dynamic AWD',
'transmission': 'automatic',
'trim': 'R-Dynamic AWD',
'year': 2019}
2026-04-27 08:03:19 [auto1.it] INFO: Saving data for JD11535: {'created_time': 1777276999.825138, 'last_price_update_time': 1777276999.82515, 'has_photos': True, 'auction_closing_time': 1777389574.0}
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_8fec97d28da69d60c3210fce3f0cb55a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_0eb6327f65860554e829cb283e7cc9d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XB11924> (referer: https://www.auto1.com/v1/car-details-view/XB11924/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56646d0>
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_e9c4e8463a4e4e56e5bba75ff8d0b058.jpg saved to cache
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06c63319-e6ee-57b2-a13a-bf92adc38d63
2026-04-27 08:03:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06c63319-e6ee-57b2-a13a-bf92adc38d63, skipping ID generation
2026-04-27 08:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c63319-e6ee-57b2-a13a-bf92adc38d63 with scrape type 1
2026-04-27 08:03:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06c63319-e6ee-57b2-a13a-bf92adc38d63 sending to next pipeline
2026-04-27 08:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 06c63319-e6ee-57b2-a13a-bf92adc38d63, identifier: GT34435
2026-04-27 08:03:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-04-27 08:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435
2026-04-27 08:03:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 06c63319-e6ee-57b2-a13a-bf92adc38d63 with identifier: GT34435 to the API
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_e9c4e8463a4e4e56e5bba75ff8d0b058.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:01:13Z',
'fuel_type': 'diesel',
'id': '06c63319-e6ee-57b2-a13a-bf92adc38d63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT34435',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Fiat',
'model': '500X',
'odometer': 110855,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67365,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_e9c4e8463a4e4e56e5bba75ff8d0b058.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71483,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_655385091c16927f09cdc2999ee82473.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_c9f5a2664863b1065d6df51cc7bfd004.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_928b5ae7a5579be50b6369546abfa8c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_b96d952b89b2e1f8df955f42cfc51fac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_ac74efa087712855124e5660c0abba4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_9bcc84967058242176ce348d6873b31f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65951,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_6e9deca1e635d8bb98d9009d41e75d80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67407,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_5301602b31483c26543a126b65f156ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_06c63319-e6ee-57b2-a13a-bf92adc38d63/06c63319-e6ee-57b2-a13a-bf92adc38d63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6c/ce/6cce6557f5efa8644e2cb1b576458e67/pa/GT34435_baed03716a3f36ee5c378bc91dc5a97e.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2015-07-29',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500X 1.6 JTDM Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2015}
2026-04-27 08:03:20 [auto1.it] INFO: Saving data for GT34435: {'created_time': 1777277000.300814, 'last_price_update_time': 1777277000.300824, 'has_photos': True, 'auction_closing_time': 1777388473.0}
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_d2fd61bde3b6265fb227c19245d5736d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY26414> (referer: https://www.auto1.com/v1/car-details-view/WY26414/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65d94d0>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_8fec97d28da69d60c3210fce3f0cb55a.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6409110>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_0eb6327f65860554e829cb283e7cc9d1.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da5c312e-a3e9-540a-bc4a-eec800792c75 with identifier: XB11924
2026-04-27 08:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5c312e-a3e9-540a-bc4a-eec800792c75 with scrape type 1
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_506b6741edc8acf4e018061510651441.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_50a43c2b612613cb8310613e1c5d57f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_754dfe9a01560c61b76db4fe8b525944.jpg not downloaded yet
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_90679913ac5fe55b6df952d8addcf919.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7cfce80f053731cb1e6a26b90a56b70e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_5b014d1c9f1e1c4311c05d3c4b3b32d9.jpg not downloaded yet
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533b210>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_d2fd61bde3b6265fb227c19245d5736d.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-04-27 08:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 1
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg not downloaded yet
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_ab73f9fec3643bff6e6b4b0c0c37f962.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_6d1e50fba23ec57c4d862c285fe72b23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg not downloaded yet
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_6a303a0c8b69fdf19ac607e1e1332467.jpg not downloaded yet
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59aee10>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_50a43c2b612613cb8310613e1c5d57f0.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_06192695905ad13d2bbacc37cb4e58d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_c480722c041bbc4959fa40549a8dff0c.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_90679913ac5fe55b6df952d8addcf919.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg not downloaded yet
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55834d0>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7cfce80f053731cb1e6a26b90a56b70e.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_20fbbdfb2eb05b396a17b3b0ae7c9ec7.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg not downloaded yet
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_d9541095e2819cde1088798552cbcf6e.jpg not downloaded yet
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b1490>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_6d1e50fba23ec57c4d862c285fe72b23.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg not downloaded yet
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_a8ca2c14cb9bb158217ea105b8d9fd78.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_6a303a0c8b69fdf19ac607e1e1332467.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg not downloaded yet
2026-04-27 08:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ76362> (referer: https://www.auto1.com/v1/car-details-view/MJ76362/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5394610>
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_06192695905ad13d2bbacc37cb4e58d4.jpg saved to cache
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0f63c4c4-bca9-56e2-a9a5-a17727364728
2026-04-27 08:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0f63c4c4-bca9-56e2-a9a5-a17727364728, skipping ID generation
2026-04-27 08:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f63c4c4-bca9-56e2-a9a5-a17727364728 with scrape type 1
2026-04-27 08:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0f63c4c4-bca9-56e2-a9a5-a17727364728 sending to next pipeline
2026-04-27 08:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0f63c4c4-bca9-56e2-a9a5-a17727364728, identifier: WZ30101
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5339250>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_90679913ac5fe55b6df952d8addcf919.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0f63c4c4-bca9-56e2-a9a5-a17727364728 with identifier: WZ30101
2026-04-27 08:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0f63c4c4-bca9-56e2-a9a5-a17727364728 with identifier: WZ30101
2026-04-27 08:03:21 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0f63c4c4-bca9-56e2-a9a5-a17727364728 with identifier: WZ30101 to the API
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_06192695905ad13d2bbacc37cb4e58d4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:34:49Z',
'fuel_type': 'diesel',
'id': '0f63c4c4-bca9-56e2-a9a5-a17727364728',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ30101',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Kia',
'model': 'Sportage',
'odometer': 141455,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67458,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_6d1e50fba23ec57c4d862c285fe72b23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_06192695905ad13d2bbacc37cb4e58d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7cfce80f053731cb1e6a26b90a56b70e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_d2fd61bde3b6265fb227c19245d5736d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65891,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_50a43c2b612613cb8310613e1c5d57f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_8fec97d28da69d60c3210fce3f0cb55a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_0eb6327f65860554e829cb283e7cc9d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_7f6530df34e876bde5a86f59dff2e369.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_fbfe8e176ed9a092c6138ca3d6303c01.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0f63c4c4-bca9-56e2-a9a5-a17727364728/0f63c4c4-bca9-56e2-a9a5-a17727364728_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/05/e70594a0917217c9f14559de7132b559/pa/WZ30101_49afb886abfb2a10f34eb59e1e48f557.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2017-04-05',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Class 2WD',
'transmission': 'manual',
'trim': 'Class 2WD',
'year': 2017}
2026-04-27 08:03:21 [auto1.it] INFO: Saving data for WZ30101: {'created_time': 1777277001.378462, 'last_price_update_time': 1777277001.378474, 'has_photos': True, 'auction_closing_time': 1777390489.0}
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg not downloaded yet
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_ab73f9fec3643bff6e6b4b0c0c37f962.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_20fbbdfb2eb05b396a17b3b0ae7c9ec7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5959250>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9b990>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_6a303a0c8b69fdf19ac607e1e1332467.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2f4e267-e896-5d25-a8d2-f48ff831c995 with identifier: MJ76362
2026-04-27 08:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f4e267-e896-5d25-a8d2-f48ff831c995 with scrape type 1
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_13ea2c1b5e347469919a1714ac98a059.jpg not downloaded yet
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg not downloaded yet
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VZ92626> (referer: https://www.auto1.com/v1/car-details-view/VZ92626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af8d18de0e96f5c758c1505136833a34.jpg not downloaded yet
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_a8ca2c14cb9bb158217ea105b8d9fd78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg not downloaded yet
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567b890>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_ab73f9fec3643bff6e6b4b0c0c37f962.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57b9290>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a0310>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_20fbbdfb2eb05b396a17b3b0ae7c9ec7.jpg saved to cache
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_39058e321f17d9bab83ece14bb6b7619.jpg not downloaded yet
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE51399> (referer: https://www.auto1.com/v1/car-details-view/RE51399/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_d9541095e2819cde1088798552cbcf6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB66719/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af511c73014a59f3426ddf8e3bf0baae.jpg not downloaded yet
2026-04-27 08:03:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-04-27 08:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 1
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg not downloaded yet
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cca90>
2026-04-27 08:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_a8ca2c14cb9bb158217ea105b8d9fd78.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_e8dc31b4a1d94b6abcbc637db7dd898b.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_13ea2c1b5e347469919a1714ac98a059.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_8efd98466a426b7d7733161ac4e0d52b.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839a3d0>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cdab1260-8ded-5054-b884-e2a426a5d4a9 with identifier: RE51399
2026-04-27 08:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdab1260-8ded-5054-b884-e2a426a5d4a9 with scrape type 1
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_470ec4c13508cf1a5a97df810bc29530.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5529f10>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_d9541095e2819cde1088798552cbcf6e.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5324650>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59cb190>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_43d60266462bc8d1fabb50d5ac4d4de2.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_c480722c041bbc4959fa40549a8dff0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af8d18de0e96f5c758c1505136833a34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_24f333ce306672524f6f20cefeb2da80.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_39058e321f17d9bab83ece14bb6b7619.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_d98c2fba47d15d3e3fb0a7c0c9105fb4.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_be8f35a6364cd118f5379e1794ccdbf9.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6465590>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550e710>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_13ea2c1b5e347469919a1714ac98a059.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_87607e1630c0fb0df9d8f7055e0a8d50.jpg not downloaded yet
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e6715a487fd6bb9a024626ffcf3b5dd3.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_9f35d77d959e074eaf0f450c8bd6518a.jpg not downloaded yet
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5660110>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5893410>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_c480722c041bbc4959fa40549a8dff0c.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ed890>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af8d18de0e96f5c758c1505136833a34.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769e90>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56f9250>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784490>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_39058e321f17d9bab83ece14bb6b7619.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64cf650>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_470ec4c13508cf1a5a97df810bc29530.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_8a95c40068a9361b3f1423ff232ed866.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_8efd98466a426b7d7733161ac4e0d52b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_e8dc31b4a1d94b6abcbc637db7dd898b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_43d60266462bc8d1fabb50d5ac4d4de2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_03ce0f827622634eae20cf55f7e3897a.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP12220> (referer: https://www.auto1.com/v1/car-details-view/FP12220/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8379a50>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57fa910>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_5776183993a21fb1ea2b229714d63dcc.jpg not downloaded yet
2026-04-27 08:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e6715a487fd6bb9a024626ffcf3b5dd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58c8210>
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_470ec4c13508cf1a5a97df810bc29530.jpg saved to cache
2026-04-27 08:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_cd3c1d7e7b50784467540cf9c5ba9a9a.jpg not downloaded yet
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5555e10>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_d98c2fba47d15d3e3fb0a7c0c9105fb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e3fcda3dd6d59ed6d12db7977cbd7f6e.jpg not downloaded yet
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c7210>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_8efd98466a426b7d7733161ac4e0d52b.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead570ac10>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_e8dc31b4a1d94b6abcbc637db7dd898b.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5787ed0>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_43d60266462bc8d1fabb50d5ac4d4de2.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with identifier: FP12220
2026-04-27 08:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with scrape type 1
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_f6043dff9de41e13d84f9f7c29d122ab.jpg not downloaded yet
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_87607e1630c0fb0df9d8f7055e0a8d50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_be8f35a6364cd118f5379e1794ccdbf9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_9f35d77d959e074eaf0f450c8bd6518a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e20113849ee3f7bc726c4cfdb8375f65.jpg not downloaded yet
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_9d5dfb4404aae484d9aa926e360df616.jpg not downloaded yet
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25250>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e6715a487fd6bb9a024626ffcf3b5dd3.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63355d0>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_d98c2fba47d15d3e3fb0a7c0c9105fb4.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_03ce0f827622634eae20cf55f7e3897a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_8a95c40068a9361b3f1423ff232ed866.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_24f333ce306672524f6f20cefeb2da80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_cba48f14efba86a87012bc6e7201f88e.jpg not downloaded yet
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_cd3c1d7e7b50784467540cf9c5ba9a9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_4a4d44616b155c01bd0df952bb926ac9.jpg not downloaded yet
2026-04-27 08:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YU29433> (referer: https://www.auto1.com/v1/car-details-view/YU29433/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a738d0>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_87607e1630c0fb0df9d8f7055e0a8d50.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5413f10>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_be8f35a6364cd118f5379e1794ccdbf9.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad710>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_9f35d77d959e074eaf0f450c8bd6518a.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead580f210>
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg saved to cache
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 97e1cd2b-d1b2-5397-991c-5860318ef193
2026-04-27 08:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 97e1cd2b-d1b2-5397-991c-5860318ef193, skipping ID generation
2026-04-27 08:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97e1cd2b-d1b2-5397-991c-5860318ef193 with scrape type 1
2026-04-27 08:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 97e1cd2b-d1b2-5397-991c-5860318ef193 sending to next pipeline
2026-04-27 08:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 97e1cd2b-d1b2-5397-991c-5860318ef193, identifier: VZ92626
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_c46b235b5a2e9da1a7a3800fc1dda25e.jpg not downloaded yet
2026-04-27 08:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-04-27 08:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626
2026-04-27 08:03:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 97e1cd2b-d1b2-5397-991c-5860318ef193 with identifier: VZ92626 to the API
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Senago',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:04:46Z',
'fuel_type': 'petrol',
'id': '97e1cd2b-d1b2-5397-991c-5860318ef193',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VZ92626',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Suzuki',
'model': 'SX4',
'odometer': 202462,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76682,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea55c08d7a4ec714787da00f4e49d78a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_def0d4930648fff1d9c9bb19ae5f0367.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81114,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_ea7bf7c23647260a30f55ae9ad60dd5b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62144,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_91250fac9acbc1ae3ff7cc4d332beffe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_97e1cd2b-d1b2-5397-991c-5860318ef193/97e1cd2b-d1b2-5397-991c-5860318ef193_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb5/a2/b5a23e22a293cddfef7e3a2e66925f00/pa/VZ92626_50f3e23ea19f02e90ea70408271210bc.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2010-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki SX4 1.6 Club',
'transmission': 'manual',
'trim': 'Club',
'year': 2010}
2026-04-27 08:03:24 [auto1.it] INFO: Saving data for VZ92626: {'created_time': 1777277004.333901, 'last_price_update_time': 1777277004.333912, 'has_photos': True, 'auction_closing_time': 1777388686.0}
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_f6043dff9de41e13d84f9f7c29d122ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af511c73014a59f3426ddf8e3bf0baae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e3fcda3dd6d59ed6d12db7977cbd7f6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_5776183993a21fb1ea2b229714d63dcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_9d5dfb4404aae484d9aa926e360df616.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e20113849ee3f7bc726c4cfdb8375f65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZC15371> (referer: https://www.auto1.com/v1/car-details-view/ZC15371/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58cbc10>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_03ce0f827622634eae20cf55f7e3897a.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a0f90>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_8a95c40068a9361b3f1423ff232ed866.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6592310>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_24f333ce306672524f6f20cefeb2da80.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead557cd10>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_cd3c1d7e7b50784467540cf9c5ba9a9a.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with identifier: YU29433
2026-04-27 08:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with scrape type 1
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a5bb7ec9f47aeaa911b58c9d1212d2e.jpg not downloaded yet
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_4a4d44616b155c01bd0df952bb926ac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_55c96fd4d9abfd0bb7fed2dfe4210c10.jpg not downloaded yet
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_754dfe9a01560c61b76db4fe8b525944.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_5b014d1c9f1e1c4311c05d3c4b3b32d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_b97c647904a1a9ca8d2e4b6963163c63.jpg not downloaded yet
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d6b50>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55938d0>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_f6043dff9de41e13d84f9f7c29d122ab.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59c8d50>
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af511c73014a59f3426ddf8e3bf0baae.jpg saved to cache
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2f4e267-e896-5d25-a8d2-f48ff831c995
2026-04-27 08:03:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2f4e267-e896-5d25-a8d2-f48ff831c995, skipping ID generation
2026-04-27 08:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a2f4e267-e896-5d25-a8d2-f48ff831c995 with scrape type 1
2026-04-27 08:03:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2f4e267-e896-5d25-a8d2-f48ff831c995 sending to next pipeline
2026-04-27 08:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a2f4e267-e896-5d25-a8d2-f48ff831c995, identifier: MJ76362
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dd150>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e3fcda3dd6d59ed6d12db7977cbd7f6e.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1fa50>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c671b85-f866-5acd-8d39-772f2c4e4d58
2026-04-27 08:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c671b85-f866-5acd-8d39-772f2c4e4d58, skipping ID generation
2026-04-27 08:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 with scrape type 1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c671b85-f866-5acd-8d39-772f2c4e4d58 sending to next pipeline
2026-04-27 08:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c671b85-f866-5acd-8d39-772f2c4e4d58, identifier: WY26414
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6488fd0>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_5776183993a21fb1ea2b229714d63dcc.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58efdd0>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_9d5dfb4404aae484d9aa926e360df616.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562a690>
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e20113849ee3f7bc726c4cfdb8375f65.jpg saved to cache
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cdab1260-8ded-5054-b884-e2a426a5d4a9
2026-04-27 08:03:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cdab1260-8ded-5054-b884-e2a426a5d4a9, skipping ID generation
2026-04-27 08:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cdab1260-8ded-5054-b884-e2a426a5d4a9 with scrape type 1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cdab1260-8ded-5054-b884-e2a426a5d4a9 sending to next pipeline
2026-04-27 08:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: cdab1260-8ded-5054-b884-e2a426a5d4a9, identifier: RE51399
2026-04-27 08:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea87293-e81d-55f3-8f13-015dba88da5a with identifier: ZC15371
2026-04-27 08:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea87293-e81d-55f3-8f13-015dba88da5a with scrape type 1
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_4c5595d8cda5425b34ff40f61c126afe.jpg not downloaded yet
2026-04-27 08:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a2f4e267-e896-5d25-a8d2-f48ff831c995 with identifier: MJ76362
2026-04-27 08:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a2f4e267-e896-5d25-a8d2-f48ff831c995 with identifier: MJ76362
2026-04-27 08:03:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a2f4e267-e896-5d25-a8d2-f48ff831c995 with identifier: MJ76362 to the API
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af511c73014a59f3426ddf8e3bf0baae.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Bentivoglio',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:11:02Z',
'fuel_type': 'diesel',
'id': 'a2f4e267-e896-5d25-a8d2-f48ff831c995',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6369,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ76362',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'location_confidence': 'geocoded',
'longitude': 11.4174,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 155208,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122981,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_13ea2c1b5e347469919a1714ac98a059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af8d18de0e96f5c758c1505136833a34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 119012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_39058e321f17d9bab83ece14bb6b7619.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_af511c73014a59f3426ddf8e3bf0baae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108799,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_e8dc31b4a1d94b6abcbc637db7dd898b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_8efd98466a426b7d7733161ac4e0d52b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79621,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_43d60266462bc8d1fabb50d5ac4d4de2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_d98c2fba47d15d3e3fb0a7c0c9105fb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_87607e1630c0fb0df9d8f7055e0a8d50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a2f4e267-e896-5d25-a8d2-f48ff831c995/a2f4e267-e896-5d25-a8d2-f48ff831c995_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf2/82/f2824a43f7098d795cebce9202618c06/pa/MJ76362_9f35d77d959e074eaf0f450c8bd6518a.jpg',
'Width': 800}],
'postal_code': '40010',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2020-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 2.0 TDI Business BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Business BlueMotion Tech',
'year': 2020}
2026-04-27 08:03:25 [auto1.it] INFO: Saving data for MJ76362: {'created_time': 1777277005.843414, 'last_price_update_time': 1777277005.843423, 'has_photos': True, 'auction_closing_time': 1777389062.0}
2026-04-27 08:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-04-27 08:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414
2026-04-27 08:03:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c671b85-f866-5acd-8d39-772f2c4e4d58 with identifier: WY26414 to the API
2026-04-27 08:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Senago',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:13:27Z',
'fuel_type': 'petrol',
'id': '4c671b85-f866-5acd-8d39-772f2c4e4d58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY26414',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 20350,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77254,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_434785d63e95b6abcca047e84b7a1972.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_74675b61766b7963603e48846c55349e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69466,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_ddec2bacb879432ba7427bc6934e763f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_067799b861078ffd940af1a7743f9b2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67945,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_e5d7256f3814c56e551512236205f30c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73914,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c8a1917cc0bdc82378f6d7420e4a6e7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_12e0ea780bdb80bb12f76fe3b0ece8a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74173,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_1fa8bb3fedd56fe4fab1962b33dcc680.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72106,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_c9d7aac908d7711e5a9b130540c5cdf4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c671b85-f866-5acd-8d39-772f2c4e4d58/4c671b85-f866-5acd-8d39-772f2c4e4d58_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/75/ff751eb15ff507c8ba6747439375c3c3/pa/WY26414_7e021cab6c2ac7635ed477b3e7e638a2.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2023-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.6 T-GDI Mild-Hybrid XLine 2WD',
'transmission': 'automatic',
'trim': 'XLine 2WD',
'year': 2023}
2026-04-27 08:03:26 [auto1.it] INFO: Saving data for WY26414: {'created_time': 1777277006.148271, 'last_price_update_time': 1777277006.148281, 'has_photos': True, 'auction_closing_time': 1777389207.0}
2026-04-27 08:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cdab1260-8ded-5054-b884-e2a426a5d4a9 with identifier: RE51399
2026-04-27 08:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cdab1260-8ded-5054-b884-e2a426a5d4a9 with identifier: RE51399
2026-04-27 08:03:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cdab1260-8ded-5054-b884-e2a426a5d4a9 with identifier: RE51399 to the API
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e20113849ee3f7bc726c4cfdb8375f65.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.4L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:02:03Z',
'fuel_type': 'petrol',
'id': 'cdab1260-8ded-5054-b884-e2a426a5d4a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE51399',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Opel',
'model': 'Meriva',
'odometer': 112610,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_470ec4c13508cf1a5a97df810bc29530.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_24f333ce306672524f6f20cefeb2da80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_be8f35a6364cd118f5379e1794ccdbf9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121071,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e6715a487fd6bb9a024626ffcf3b5dd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137186,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_8a95c40068a9361b3f1423ff232ed866.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141083,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_03ce0f827622634eae20cf55f7e3897a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_5776183993a21fb1ea2b229714d63dcc.jpg',
'Width': 658},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_cd3c1d7e7b50784467540cf9c5ba9a9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e3fcda3dd6d59ed6d12db7977cbd7f6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cdab1260-8ded-5054-b884-e2a426a5d4a9/cdab1260-8ded-5054-b884-e2a426a5d4a9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img73/65/73659430b4fd6a5aa5661b041ce60102/pa/RE51399_e20113849ee3f7bc726c4cfdb8375f65.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2015-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Meriva 1.4 Turbo Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2015}
2026-04-27 08:03:26 [auto1.it] INFO: Saving data for RE51399: {'created_time': 1777277006.450773, 'last_price_update_time': 1777277006.450785, 'has_photos': True, 'auction_closing_time': 1777388523.0}
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_cba48f14efba86a87012bc6e7201f88e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_6a636ef49c77b8120b41ce3f6376ef6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_c46b235b5a2e9da1a7a3800fc1dda25e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_506b6741edc8acf4e018061510651441.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_dac214947244d2bd509a85a8a3b82fca.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_979bf0011ec37b4a8a6faec716b68eaf.jpg not downloaded yet
2026-04-27 08:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a5bb7ec9f47aeaa911b58c9d1212d2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_e48eb33a40ca776d17c248480638c7e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB66719> (referer: https://www.auto1.com/v1/car-details-view/JB66719/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TD68261> (referer: https://www.auto1.com/v1/car-details-view/TD68261/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65e2f90>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_4a4d44616b155c01bd0df952bb926ac9.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bd890>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_754dfe9a01560c61b76db4fe8b525944.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64e3c50>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_5b014d1c9f1e1c4311c05d3c4b3b32d9.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_55c96fd4d9abfd0bb7fed2dfe4210c10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9a4554baf79a277089eb45b383beda7b.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1891bf2cdeb0edebd88ca877097ae176.jpg not downloaded yet
2026-04-27 08:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VD09142> (referer: https://www.auto1.com/v1/car-details-view/VD09142/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f62f1aed6602704d9c6a781a2449a06a.jpg not downloaded yet
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_49559104201114f7b27f2c894ecfd3a7.jpg not downloaded yet
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57bf910>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_cba48f14efba86a87012bc6e7201f88e.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5510710>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_6a636ef49c77b8120b41ce3f6376ef6c.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a289d0>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_c46b235b5a2e9da1a7a3800fc1dda25e.jpg saved to cache
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2
2026-04-27 08:03:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2, skipping ID generation
2026-04-27 08:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with scrape type 1
2026-04-27 08:03:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 sending to next pipeline
2026-04-27 08:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2, identifier: FP12220
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ca3d0>
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_506b6741edc8acf4e018061510651441.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da5c312e-a3e9-540a-bc4a-eec800792c75
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da5c312e-a3e9-540a-bc4a-eec800792c75, skipping ID generation
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da5c312e-a3e9-540a-bc4a-eec800792c75 with scrape type 1
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da5c312e-a3e9-540a-bc4a-eec800792c75 sending to next pipeline
2026-04-27 08:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: da5c312e-a3e9-540a-bc4a-eec800792c75, identifier: XB11924
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5750790>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a5bb7ec9f47aeaa911b58c9d1212d2e.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f89d0>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_e48eb33a40ca776d17c248480638c7e6.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59b5390>
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg saved to cache
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f84d875-01da-512d-bdf6-34efbe22bb26 with identifier: JB66719
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f84d875-01da-512d-bdf6-34efbe22bb26 with scrape type 1
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_2ed5daed4c95dd2f431e40efac511cd5.jpg not downloaded yet
2026-04-27 08:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e28d803-8fad-5fd8-9775-f87e11fc1898 with identifier: TD68261
2026-04-27 08:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e28d803-8fad-5fd8-9775-f87e11fc1898 with scrape type 1
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_71453772e436e9c75ac9a52f947d64a5.jpg not downloaded yet
2026-04-27 08:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_81b5e9c6527d615a6bc3beec2cb0a95b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with identifier: FP12220
2026-04-27 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with identifier: FP12220
2026-04-27 08:03:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2 with identifier: FP12220 to the API
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_c46b235b5a2e9da1a7a3800fc1dda25e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 139,
'category': None,
'city': 'Reggio Emilia',
'color': 'orange',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:39:18Z',
'fuel_type': 'diesel',
'id': '7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP12220',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Suzuki',
'model': 'SX4',
'odometer': 352405,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88638,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_f6043dff9de41e13d84f9f7c29d122ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_9d5dfb4404aae484d9aa926e360df616.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82418,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_cba48f14efba86a87012bc6e7201f88e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_4a4d44616b155c01bd0df952bb926ac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2/7c3f7ff8-14b6-50a1-8c0e-eb1e932b91a2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47328,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0b/25/0b25af0aa08eeb9ff04f69efd72b0568/pa/FP12220_c46b235b5a2e9da1a7a3800fc1dda25e.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2010-01-24',
'seats_number': 5,
'seller_name': None,
'title': 'Suzuki SX4 1.6 DDiS Club/Outdoorline',
'transmission': 'manual',
'trim': 'Club/Outdoorline',
'year': 2010}
2026-04-27 08:03:27 [auto1.it] INFO: Saving data for FP12220: {'created_time': 1777277007.675517, 'last_price_update_time': 1777277007.675528, 'has_photos': True, 'auction_closing_time': 1777390758.0}
2026-04-27 08:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: da5c312e-a3e9-540a-bc4a-eec800792c75 with identifier: XB11924
2026-04-27 08:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: da5c312e-a3e9-540a-bc4a-eec800792c75 with identifier: XB11924
2026-04-27 08:03:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: da5c312e-a3e9-540a-bc4a-eec800792c75 with identifier: XB11924 to the API
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_506b6741edc8acf4e018061510651441.jpg>
{'auction_title': '',
'c_o_2_emission_value': 144,
'category': None,
'city': 'Roma',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 177,
'expiration_date': '2026-04-28T15:58:26Z',
'fuel_type': 'diesel',
'id': 'da5c312e-a3e9-540a-bc4a-eec800792c75',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XB11924',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'BMW',
'model': '3er',
'odometer': 95557,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108964,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_506b6741edc8acf4e018061510651441.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105875,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_754dfe9a01560c61b76db4fe8b525944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_90679913ac5fe55b6df952d8addcf919.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_5b014d1c9f1e1c4311c05d3c4b3b32d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110267,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_ab73f9fec3643bff6e6b4b0c0c37f962.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104248,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_6a303a0c8b69fdf19ac607e1e1332467.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89912,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_c480722c041bbc4959fa40549a8dff0c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_20fbbdfb2eb05b396a17b3b0ae7c9ec7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_d9541095e2819cde1088798552cbcf6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_da5c312e-a3e9-540a-bc4a-eec800792c75/da5c312e-a3e9-540a-bc4a-eec800792c75_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/a7/2ba71192955bcbe456ecbb70a1f1aa01/pa/XB11924_a8ca2c14cb9bb158217ea105b8d9fd78.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2009-03-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 320d',
'transmission': 'automatic',
'trim': '',
'year': 2009}
2026-04-27 08:03:28 [auto1.it] INFO: Saving data for XB11924: {'created_time': 1777277008.062955, 'last_price_update_time': 1777277008.062976, 'has_photos': True, 'auction_closing_time': 1777391906.0}
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_4c5595d8cda5425b34ff40f61c126afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_979bf0011ec37b4a8a6faec716b68eaf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_b97c647904a1a9ca8d2e4b6963163c63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9db91b330f27c58971d456c42bd6f9c9.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1c9ff1de0b321b4879b3ab05dfc6f276.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_6ac145fa8abcbaa228f9708a5cd7835b.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_209b28c39b2eccd69bc5c438743eae10.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_7ed3c54a793b3ba14ad92c3570e6323a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_62aba7074c1e1499ccfe44af5ae19bea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_0aac1cc1465fe27e7dcef432ba042278.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BN85160> (referer: https://www.auto1.com/v1/car-details-view/BN85160/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f3dbde2c25c89886ed45ebc70b1ed484.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1bf033ff0796156aca8dba1bb93544d6.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_0dd936eee1c4a9508dde55cf23bc8dea.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_56aecc2b4c21eb0d6d207cfe85ded9d5.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MJ42614/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551bbd0>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_55c96fd4d9abfd0bb7fed2dfe4210c10.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c4fa7b-6959-531e-a401-c8a135d33530 with identifier: VD09142
2026-04-27 08:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c4fa7b-6959-531e-a401-c8a135d33530 with scrape type 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_521503e78bc9fd34091f9cc304bd58a1.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5584390>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_81b5e9c6527d615a6bc3beec2cb0a95b.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_dac214947244d2bd509a85a8a3b82fca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_078eddfbaf5af226a54547796bddd212.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_92b8180f3dd4f413123ced72c69f43ed.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_799980b0a7d1c7caffdcba69a20e04dd.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_506483b95278aca32c9142fb361ee34b.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_148d7ed766a2fc3f9c32f6dbf767e33a.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_2ed5daed4c95dd2f431e40efac511cd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_71453772e436e9c75ac9a52f947d64a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f62f1aed6602704d9c6a781a2449a06a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63c6a10>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_4c5595d8cda5425b34ff40f61c126afe.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56289d0>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_979bf0011ec37b4a8a6faec716b68eaf.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5584450>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_b97c647904a1a9ca8d2e4b6963163c63.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead562a310>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_7ed3c54a793b3ba14ad92c3570e6323a.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58ad4d0>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_62aba7074c1e1499ccfe44af5ae19bea.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5989450>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_0aac1cc1465fe27e7dcef432ba042278.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5989e50>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg saved to cache
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 82af07dd-bedc-54ec-8755-c175a177b170 with identifier: BN85160
2026-04-27 08:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82af07dd-bedc-54ec-8755-c175a177b170 with scrape type 1
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_6611404a920fba086461357489126635.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_49559104201114f7b27f2c894ecfd3a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a6b278a7a33f196b0e166f457aeda6f.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_37421f3e182e11e8079eeef16bb3cef3.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_7315aecf4540a10aa2d7af05a50817ce.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_9cb1d442e5d9d5817e05876e9451d202.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_12b3693f24fedf12de37a3c805c39b87.jpg not downloaded yet
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9a4554baf79a277089eb45b383beda7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1891bf2cdeb0edebd88ca877097ae176.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_8b8a7bde4a1b632b25e7a0d3f96e6b7f.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_e2de7612faac789db3c41c30feb57774.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_4487be1cfb526323d8895dd0d1daa898.jpg not downloaded yet
2026-04-27 08:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_1be86a14d5e5f3760141f2d140994235.jpg not downloaded yet
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b8490>
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_dac214947244d2bd509a85a8a3b82fca.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5961dd0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_2ed5daed4c95dd2f431e40efac511cd5.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58989d0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_71453772e436e9c75ac9a52f947d64a5.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5459dd0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f62f1aed6602704d9c6a781a2449a06a.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_209b28c39b2eccd69bc5c438743eae10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_6ac145fa8abcbaa228f9708a5cd7835b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_2eca34a2ed3ca3907f5f2cf4e89654b0.jpg not downloaded yet
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_521503e78bc9fd34091f9cc304bd58a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_a089e67e9611b8fa230a69ebf4fe755e.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_30461709aca2e9560c811b1b87860f91.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_dff766a6d1319f0e08c23d6bab1123e3.jpg not downloaded yet
2026-04-27 08:03:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55cea50>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_49559104201114f7b27f2c894ecfd3a7.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_27294199e59bb4e786c648e87b250a1c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b8bd9da17abb8bd337b92168e2ce381e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_253a0d658ba27d4aa2b65a15a8fd75b6.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_a95a2435e1085ed313cfe33bb2a26035.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_87c704af4dd9abe59d1c58a4f6789c5d.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_663bafb74d2637a708d4b69788970dfb.jpg not downloaded yet
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55ce3d0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9a4554baf79a277089eb45b383beda7b.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead553ce50>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1891bf2cdeb0edebd88ca877097ae176.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567ee50>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e390>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_209b28c39b2eccd69bc5c438743eae10.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567ed90>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_6ac145fa8abcbaa228f9708a5cd7835b.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_56aecc2b4c21eb0d6d207cfe85ded9d5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_10970744dd2539b4c41b76a9f1ac84a7.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_e5ceeb49814543e348086bdf8420b436.jpg not downloaded yet
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_7315aecf4540a10aa2d7af05a50817ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1bf033ff0796156aca8dba1bb93544d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_0dd936eee1c4a9508dde55cf23bc8dea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_9cb1d442e5d9d5817e05876e9451d202.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_12b3693f24fedf12de37a3c805c39b87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_fd01bcfca3c476a004e414148c6d40ae.jpg not downloaded yet
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a6e450>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_521503e78bc9fd34091f9cc304bd58a1.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_1be86a14d5e5f3760141f2d140994235.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_148d7ed766a2fc3f9c32f6dbf767e33a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_7210392b580c46de914c414a9f0ec23d.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_50bb54d2e8823d640b8938d346745d6e.jpg not downloaded yet
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5699890>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_27294199e59bb4e786c648e87b250a1c.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ac9d0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b8bd9da17abb8bd337b92168e2ce381e.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_f85b82e40052b921d269bbc01cbceba3.jpg not downloaded yet
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_2eca34a2ed3ca3907f5f2cf4e89654b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_4487be1cfb526323d8895dd0d1daa898.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_5369290f28ee8ca9d0a9f9bfb5f4446f.jpg not downloaded yet
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fa9d0>
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_56aecc2b4c21eb0d6d207cfe85ded9d5.jpg saved to cache
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_ccb6f0263fe9d7c92f7f125125dba21b.jpg not downloaded yet
2026-04-27 08:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_cd1ceee0c53ed49b6e1b3ff1a430fd87.jpg not downloaded yet
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_dff766a6d1319f0e08c23d6bab1123e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_87c704af4dd9abe59d1c58a4f6789c5d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_9db35aadd8e2cab981a9325bd0fd5e5a.jpg not downloaded yet
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dd990>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_7315aecf4540a10aa2d7af05a50817ce.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f0090>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1bf033ff0796156aca8dba1bb93544d6.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a9350>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_0dd936eee1c4a9508dde55cf23bc8dea.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ed50>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_9cb1d442e5d9d5817e05876e9451d202.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58809d0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_12b3693f24fedf12de37a3c805c39b87.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5867290>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_1be86a14d5e5f3760141f2d140994235.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a1cd0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_148d7ed766a2fc3f9c32f6dbf767e33a.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_e2de7612faac789db3c41c30feb57774.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_253a0d658ba27d4aa2b65a15a8fd75b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_663bafb74d2637a708d4b69788970dfb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_e5ceeb49814543e348086bdf8420b436.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_a95a2435e1085ed313cfe33bb2a26035.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_30461709aca2e9560c811b1b87860f91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_d85efaf4aed022f7c7649a8a9a5771e1.jpg not downloaded yet
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bc950>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_2eca34a2ed3ca3907f5f2cf4e89654b0.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587d890>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_4487be1cfb526323d8895dd0d1daa898.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f1510>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_dff766a6d1319f0e08c23d6bab1123e3.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29150>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_87c704af4dd9abe59d1c58a4f6789c5d.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_ccb6f0263fe9d7c92f7f125125dba21b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_10970744dd2539b4c41b76a9f1ac84a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_fd01bcfca3c476a004e414148c6d40ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_cd1ceee0c53ed49b6e1b3ff1a430fd87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_7210392b580c46de914c414a9f0ec23d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6354ad0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_e2de7612faac789db3c41c30feb57774.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581cdd0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_253a0d658ba27d4aa2b65a15a8fd75b6.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5787390>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_663bafb74d2637a708d4b69788970dfb.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6110>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_e5ceeb49814543e348086bdf8420b436.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead571ea90>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_a95a2435e1085ed313cfe33bb2a26035.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a28d0>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_30461709aca2e9560c811b1b87860f91.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_5369290f28ee8ca9d0a9f9bfb5f4446f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_f85b82e40052b921d269bbc01cbceba3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_50bb54d2e8823d640b8938d346745d6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_a089e67e9611b8fa230a69ebf4fe755e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fc250>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_ccb6f0263fe9d7c92f7f125125dba21b.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582310>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_10970744dd2539b4c41b76a9f1ac84a7.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c510>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_fd01bcfca3c476a004e414148c6d40ae.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead637b650>
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_cd1ceee0c53ed49b6e1b3ff1a430fd87.jpg saved to cache
2026-04-27 08:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55557d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_7210392b580c46de914c414a9f0ec23d.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_8b8a7bde4a1b632b25e7a0d3f96e6b7f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_d85efaf4aed022f7c7649a8a9a5771e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a6b278a7a33f196b0e166f457aeda6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_9db35aadd8e2cab981a9325bd0fd5e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_6611404a920fba086461357489126635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_37421f3e182e11e8079eeef16bb3cef3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63b9150>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_5369290f28ee8ca9d0a9f9bfb5f4446f.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d4290>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_f85b82e40052b921d269bbc01cbceba3.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548c9d0>
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_50bb54d2e8823d640b8938d346745d6e.jpg saved to cache
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b5c4fa7b-6959-531e-a401-c8a135d33530
2026-04-27 08:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5c4fa7b-6959-531e-a401-c8a135d33530, skipping ID generation
2026-04-27 08:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c4fa7b-6959-531e-a401-c8a135d33530 with scrape type 1
2026-04-27 08:03:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b5c4fa7b-6959-531e-a401-c8a135d33530 sending to next pipeline
2026-04-27 08:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b5c4fa7b-6959-531e-a401-c8a135d33530, identifier: VD09142
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d6f10>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_a089e67e9611b8fa230a69ebf4fe755e.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b5c4fa7b-6959-531e-a401-c8a135d33530 with identifier: VD09142
2026-04-27 08:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b5c4fa7b-6959-531e-a401-c8a135d33530 with identifier: VD09142
2026-04-27 08:03:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b5c4fa7b-6959-531e-a401-c8a135d33530 with identifier: VD09142 to the API
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_50bb54d2e8823d640b8938d346745d6e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.4L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:36:16Z',
'fuel_type': 'petrol',
'id': 'b5c4fa7b-6959-531e-a401-c8a135d33530',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD09142',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Fiat',
'model': '500L',
'odometer': 130902,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79336,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_521503e78bc9fd34091f9cc304bd58a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_148d7ed766a2fc3f9c32f6dbf767e33a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75488,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_12b3693f24fedf12de37a3c805c39b87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_1be86a14d5e5f3760141f2d140994235.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_dff766a6d1319f0e08c23d6bab1123e3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72566,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_87c704af4dd9abe59d1c58a4f6789c5d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_e5ceeb49814543e348086bdf8420b436.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80065,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_50bb54d2e8823d640b8938d346745d6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_5369290f28ee8ca9d0a9f9bfb5f4446f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b5c4fa7b-6959-531e-a401-c8a135d33530/b5c4fa7b-6959-531e-a401-c8a135d33530_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge2/15/e215953ebbe564d35160f56dc52cfd8a/pa/VD09142_cd1ceee0c53ed49b6e1b3ff1a430fd87.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2017-04-20',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.4 Pop Star',
'transmission': 'manual',
'trim': 'Pop Star',
'year': 2017}
2026-04-27 08:03:32 [auto1.it] INFO: Saving data for VD09142: {'created_time': 1777277012.481363, 'last_price_update_time': 1777277012.481374, 'has_photos': True, 'auction_closing_time': 1777390576.0}
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_078eddfbaf5af226a54547796bddd212.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9db91b330f27c58971d456c42bd6f9c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1c9ff1de0b321b4879b3ab05dfc6f276.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_799980b0a7d1c7caffdcba69a20e04dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f3dbde2c25c89886ed45ebc70b1ed484.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_92b8180f3dd4f413123ced72c69f43ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_506483b95278aca32c9142fb361ee34b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MJ42614> (referer: https://www.auto1.com/v1/car-details-view/MJ42614/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LF46608/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead589d650>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_8b8a7bde4a1b632b25e7a0d3f96e6b7f.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5396a90>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_d85efaf4aed022f7c7649a8a9a5771e1.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5835b10>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a6b278a7a33f196b0e166f457aeda6f.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a22d0>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_9db35aadd8e2cab981a9325bd0fd5e5a.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8379950>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_6611404a920fba086461357489126635.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 82af07dd-bedc-54ec-8755-c175a177b170
2026-04-27 08:03:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 82af07dd-bedc-54ec-8755-c175a177b170, skipping ID generation
2026-04-27 08:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 82af07dd-bedc-54ec-8755-c175a177b170 with scrape type 1
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 82af07dd-bedc-54ec-8755-c175a177b170 sending to next pipeline
2026-04-27 08:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 82af07dd-bedc-54ec-8755-c175a177b170, identifier: BN85160
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead568a950>
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_37421f3e182e11e8079eeef16bb3cef3.jpg saved to cache
2026-04-27 08:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 82af07dd-bedc-54ec-8755-c175a177b170 with identifier: BN85160
2026-04-27 08:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 82af07dd-bedc-54ec-8755-c175a177b170 with identifier: BN85160
2026-04-27 08:03:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 82af07dd-bedc-54ec-8755-c175a177b170 with identifier: BN85160 to the API
2026-04-27 08:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_6611404a920fba086461357489126635.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Capannori',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-04-28T15:12:13Z',
'fuel_type': 'diesel',
'id': '82af07dd-bedc-54ec-8755-c175a177b170',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN85160',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Peugeot',
'model': '208',
'odometer': 135034,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65586,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_6611404a920fba086461357489126635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61266,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_8b8a7bde4a1b632b25e7a0d3f96e6b7f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_2eca34a2ed3ca3907f5f2cf4e89654b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_253a0d658ba27d4aa2b65a15a8fd75b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_663bafb74d2637a708d4b69788970dfb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_fd01bcfca3c476a004e414148c6d40ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_f85b82e40052b921d269bbc01cbceba3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60562,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_ccb6f0263fe9d7c92f7f125125dba21b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56066,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_9db35aadd8e2cab981a9325bd0fd5e5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_82af07dd-bedc-54ec-8755-c175a177b170/82af07dd-bedc-54ec-8755-c175a177b170_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/a8/d6a86d82a16dda5c4a3d11ef82be9e83/pa/BN85160_d85efaf4aed022f7c7649a8a9a5771e1.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2014}
2026-04-27 08:03:33 [auto1.it] INFO: Saving data for BN85160: {'created_time': 1777277013.255603, 'last_price_update_time': 1777277013.255616, 'has_photos': True, 'auction_closing_time': 1777389133.0}
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5ab1d965cc841e4f9caa190f54c7f211.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_d20e286e1a48fbe685e66b977653c5c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_30065954273aeee680efbe9a868bc2c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_c3808d6f7a69dc49b8c5b6139dcdeb53.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_be7c429d666544c23812f9c52be71219.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_d59db95c43175becdbcc6f55f4a867b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5699b50>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_078eddfbaf5af226a54547796bddd212.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1f290>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9db91b330f27c58971d456c42bd6f9c9.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5814510>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1c9ff1de0b321b4879b3ab05dfc6f276.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5945550>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_799980b0a7d1c7caffdcba69a20e04dd.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f84d875-01da-512d-bdf6-34efbe22bb26
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f84d875-01da-512d-bdf6-34efbe22bb26, skipping ID generation
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f84d875-01da-512d-bdf6-34efbe22bb26 with scrape type 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f84d875-01da-512d-bdf6-34efbe22bb26 sending to next pipeline
2026-04-27 08:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3f84d875-01da-512d-bdf6-34efbe22bb26, identifier: JB66719
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8490>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f3dbde2c25c89886ed45ebc70b1ed484.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7, skipping ID generation
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with scrape type 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 sending to next pipeline
2026-04-27 08:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7, identifier: YU29433
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4e09e90>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_92b8180f3dd4f413123ced72c69f43ed.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ea87293-e81d-55f3-8f13-015dba88da5a
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ea87293-e81d-55f3-8f13-015dba88da5a, skipping ID generation
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea87293-e81d-55f3-8f13-015dba88da5a with scrape type 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ea87293-e81d-55f3-8f13-015dba88da5a sending to next pipeline
2026-04-27 08:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9ea87293-e81d-55f3-8f13-015dba88da5a, identifier: ZC15371
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56b3050>
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:33 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_506483b95278aca32c9142fb361ee34b.jpg saved to cache
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2e28d803-8fad-5fd8-9775-f87e11fc1898
2026-04-27 08:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2e28d803-8fad-5fd8-9775-f87e11fc1898, skipping ID generation
2026-04-27 08:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e28d803-8fad-5fd8-9775-f87e11fc1898 with scrape type 1
2026-04-27 08:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2e28d803-8fad-5fd8-9775-f87e11fc1898 sending to next pipeline
2026-04-27 08:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2e28d803-8fad-5fd8-9775-f87e11fc1898, identifier: TD68261
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58a1ad0>
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg saved to cache
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-04-27 08:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ae398f-e974-5d88-becd-4b2f3809f826 with scrape type 1
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_038419573696d6e345c7abd5a963a89d.jpg not downloaded yet
2026-04-27 08:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3f84d875-01da-512d-bdf6-34efbe22bb26 with identifier: JB66719
2026-04-27 08:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3f84d875-01da-512d-bdf6-34efbe22bb26 with identifier: JB66719
2026-04-27 08:03:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3f84d875-01da-512d-bdf6-34efbe22bb26 with identifier: JB66719 to the API
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_799980b0a7d1c7caffdcba69a20e04dd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Reggio Emilia',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:18:37Z',
'fuel_type': 'petrol',
'id': '3f84d875-01da-512d-bdf6-34efbe22bb26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB66719',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Fiat',
'model': '500',
'odometer': 192731,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75351,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_2ed5daed4c95dd2f431e40efac511cd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72540,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_6ac145fa8abcbaa228f9708a5cd7835b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66168,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_0dd936eee1c4a9508dde55cf23bc8dea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63427,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_799980b0a7d1c7caffdcba69a20e04dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3f84d875-01da-512d-bdf6-34efbe22bb26/3f84d875-01da-512d-bdf6-34efbe22bb26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51245,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img75/a1/75a1ed78d4827920e716e8c369d36ef5/pa/JB66719_7315aecf4540a10aa2d7af05a50817ce.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2009-09-30',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 1.2 Lounge',
'transmission': 'manual',
'trim': 'Lounge',
'year': 2009}
2026-04-27 08:03:34 [auto1.it] INFO: Saving data for JB66719: {'created_time': 1777277014.47454, 'last_price_update_time': 1777277014.47455, 'has_photos': True, 'auction_closing_time': 1777389517.0}
2026-04-27 08:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with identifier: YU29433
2026-04-27 08:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with identifier: YU29433
2026-04-27 08:03:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e10679f5-ddb4-55a7-98ba-c60e68d7b5d7 with identifier: YU29433 to the API
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f3dbde2c25c89886ed45ebc70b1ed484.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Reggio Emilia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:15:07Z',
'fuel_type': 'petrol',
'id': 'e10679f5-ddb4-55a7-98ba-c60e68d7b5d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU29433',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Ford',
'model': 'Ka',
'odometer': 28662,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61326,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a5bb7ec9f47aeaa911b58c9d1212d2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58181,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_55c96fd4d9abfd0bb7fed2dfe4210c10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_b97c647904a1a9ca8d2e4b6963163c63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_dac214947244d2bd509a85a8a3b82fca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63938,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9a4554baf79a277089eb45b383beda7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f62f1aed6602704d9c6a781a2449a06a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55434,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_9db91b330f27c58971d456c42bd6f9c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_f3dbde2c25c89886ed45ebc70b1ed484.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56108,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_078eddfbaf5af226a54547796bddd212.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e10679f5-ddb4-55a7-98ba-c60e68d7b5d7/e10679f5-ddb4-55a7-98ba-c60e68d7b5d7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img11/67/1167f58e574cf8b86942bf0a4841dc06/pa/YU29433_2a6b278a7a33f196b0e166f457aeda6f.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2015-04-28',
'seats_number': 4,
'seller_name': None,
'title': 'Ford Ka 1.2 Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2015}
2026-04-27 08:03:34 [auto1.it] INFO: Saving data for YU29433: {'created_time': 1777277014.825297, 'last_price_update_time': 1777277014.825313, 'has_photos': True, 'auction_closing_time': 1777389307.0}
2026-04-27 08:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9ea87293-e81d-55f3-8f13-015dba88da5a with identifier: ZC15371
2026-04-27 08:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9ea87293-e81d-55f3-8f13-015dba88da5a with identifier: ZC15371
2026-04-27 08:03:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9ea87293-e81d-55f3-8f13-015dba88da5a with identifier: ZC15371 to the API
2026-04-27 08:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_92b8180f3dd4f413123ced72c69f43ed.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Reggio Emilia',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 106,
'expiration_date': '2026-04-28T15:58:39Z',
'fuel_type': 'petrol',
'id': '9ea87293-e81d-55f3-8f13-015dba88da5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZC15371',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'MG',
'model': 'ZS',
'odometer': 22770,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_4c5595d8cda5425b34ff40f61c126afe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_979bf0011ec37b4a8a6faec716b68eaf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62585,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1891bf2cdeb0edebd88ca877097ae176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_49559104201114f7b27f2c894ecfd3a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64527,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1c9ff1de0b321b4879b3ab05dfc6f276.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64596,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_1bf033ff0796156aca8dba1bb93544d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_92b8180f3dd4f413123ced72c69f43ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_37421f3e182e11e8079eeef16bb3cef3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76936,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_e2de7612faac789db3c41c30feb57774.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9ea87293-e81d-55f3-8f13-015dba88da5a/9ea87293-e81d-55f3-8f13-015dba88da5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65485,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img24/f7/24f780b92164938fb0d9e991be129125/pa/ZC15371_a089e67e9611b8fa230a69ebf4fe755e.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2023-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'MG ZS 1.5 VTi Comfort',
'transmission': 'manual',
'trim': 'Comfort',
'year': 2023}
2026-04-27 08:03:35 [auto1.it] INFO: Saving data for ZC15371: {'created_time': 1777277015.170898, 'last_price_update_time': 1777277015.170908, 'has_photos': True, 'auction_closing_time': 1777391919.0}
2026-04-27 08:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2e28d803-8fad-5fd8-9775-f87e11fc1898 with identifier: TD68261
2026-04-27 08:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2e28d803-8fad-5fd8-9775-f87e11fc1898 with identifier: TD68261
2026-04-27 08:03:35 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2e28d803-8fad-5fd8-9775-f87e11fc1898 with identifier: TD68261 to the API
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_506483b95278aca32c9142fb361ee34b.jpg>
{'auction_title': '',
'c_o_2_emission_value': 291,
'category': None,
'city': 'Milazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '3.0L',
'engine_horse_power': 245,
'expiration_date': '2026-04-28T15:16:56Z',
'fuel_type': 'petrol',
'id': '2e28d803-8fad-5fd8-9775-f87e11fc1898',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD68261',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Subaru',
'model': 'Tribeca',
'odometer': 196367,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_71453772e436e9c75ac9a52f947d64a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_209b28c39b2eccd69bc5c438743eae10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86228,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_56aecc2b4c21eb0d6d207cfe85ded9d5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_506483b95278aca32c9142fb361ee34b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75399,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_9cb1d442e5d9d5817e05876e9451d202.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_4487be1cfb526323d8895dd0d1daa898.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69376,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_30461709aca2e9560c811b1b87860f91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109312,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_a95a2435e1085ed313cfe33bb2a26035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_10970744dd2539b4c41b76a9f1ac84a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2e28d803-8fad-5fd8-9775-f87e11fc1898/2e28d803-8fad-5fd8-9775-f87e11fc1898_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5b/52/5b522e7ba6a1c18c38d77055ba7b93e4/pa/TD68261_7210392b580c46de914c414a9f0ec23d.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2007-02-05',
'seats_number': 7,
'seller_name': None,
'title': 'Subaru Tribeca 3.0 Active',
'transmission': 'automatic',
'trim': 'Active',
'year': 2007}
2026-04-27 08:03:35 [auto1.it] INFO: Saving data for TD68261: {'created_time': 1777277015.544484, 'last_price_update_time': 1777277015.544545, 'has_photos': True, 'auction_closing_time': 1777389416.0}
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_f02177659ecf5d656b494c55f3674bd1.jpg not downloaded yet
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6d155f45ad89f99d756c5fb11a99ca26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH87663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_1d9e106af83b1b1ddc88ef08772f60c7.jpg not downloaded yet
2026-04-27 08:03:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a88e50>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5ab1d965cc841e4f9caa190f54c7f211.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a03610>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_d20e286e1a48fbe685e66b977653c5c0.jpg saved to cache
2026-04-27 08:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6445910>
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_30065954273aeee680efbe9a868bc2c4.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58847d0>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_c3808d6f7a69dc49b8c5b6139dcdeb53.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a9a290>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55d7850>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c0cd0>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_be7c429d666544c23812f9c52be71219.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0
2026-04-27 08:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 58f872d3-1b7a-5b9e-8d83-47bd867222e0, skipping ID generation
2026-04-27 08:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with scrape type 1
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 58f872d3-1b7a-5b9e-8d83-47bd867222e0 sending to next pipeline
2026-04-27 08:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 58f872d3-1b7a-5b9e-8d83-47bd867222e0, identifier: MK90568
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476a50>
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_d59db95c43175becdbcc6f55f4a867b1.jpg saved to cache
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa660a89-4cff-55f1-9861-d70f588c35b3
2026-04-27 08:03:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa660a89-4cff-55f1-9861-d70f588c35b3, skipping ID generation
2026-04-27 08:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa660a89-4cff-55f1-9861-d70f588c35b3 with scrape type 1
2026-04-27 08:03:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa660a89-4cff-55f1-9861-d70f588c35b3 sending to next pipeline
2026-04-27 08:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: aa660a89-4cff-55f1-9861-d70f588c35b3, identifier: GY98380
2026-04-27 08:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with identifier: MK90568
2026-04-27 08:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with identifier: MK90568
2026-04-27 08:03:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 58f872d3-1b7a-5b9e-8d83-47bd867222e0 with identifier: MK90568 to the API
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_be7c429d666544c23812f9c52be71219.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Senago',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:25:59Z',
'fuel_type': 'diesel',
'id': '58f872d3-1b7a-5b9e-8d83-47bd867222e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MK90568',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'BMW',
'model': 'X4',
'odometer': 356559,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_be7c429d666544c23812f9c52be71219.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_c3808d6f7a69dc49b8c5b6139dcdeb53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_d20e286e1a48fbe685e66b977653c5c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75749,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b8bd9da17abb8bd337b92168e2ce381e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_62aba7074c1e1499ccfe44af5ae19bea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_81b5e9c6527d615a6bc3beec2cb0a95b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_e48eb33a40ca776d17c248480638c7e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103501,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_b6bf45df4d37abeca8230b7093c09a4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95275,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_03a774a0a0681a1694027c3b13d2abd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_58f872d3-1b7a-5b9e-8d83-47bd867222e0/58f872d3-1b7a-5b9e-8d83-47bd867222e0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga0/98/a09858b875c56879e46de98ec1dad886/pa/MK90568_f572c9927dde5bd75896450c916986fc.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2017-06-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X4 xDrive 20d Sport',
'transmission': 'automatic',
'trim': 'Sport',
'year': 2017}
2026-04-27 08:03:36 [auto1.it] INFO: Saving data for MK90568: {'created_time': 1777277016.731378, 'last_price_update_time': 1777277016.731388, 'has_photos': True, 'auction_closing_time': 1777389959.0}
2026-04-27 08:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: aa660a89-4cff-55f1-9861-d70f588c35b3 with identifier: GY98380
2026-04-27 08:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: aa660a89-4cff-55f1-9861-d70f588c35b3 with identifier: GY98380
2026-04-27 08:03:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: aa660a89-4cff-55f1-9861-d70f588c35b3 with identifier: GY98380 to the API
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_d59db95c43175becdbcc6f55f4a867b1.jpg>
{'auction_title': '',
'c_o_2_emission_value': 182,
'category': None,
'city': 'Manoppello',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 250,
'expiration_date': '2026-04-28T15:47:14Z',
'fuel_type': 'diesel',
'id': 'aa660a89-4cff-55f1-9861-d70f588c35b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 42.2592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY98380',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'location_confidence': 'geocoded',
'longitude': 14.0602,
'make': 'Land Rover',
'model': 'Range Rover Sport',
'odometer': 225106,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_d59db95c43175becdbcc6f55f4a867b1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5ab1d965cc841e4f9caa190f54c7f211.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_30065954273aeee680efbe9a868bc2c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68947,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_27294199e59bb4e786c648e87b250a1c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_7ed3c54a793b3ba14ad92c3570e6323a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68864,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_0aac1cc1465fe27e7dcef432ba042278.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_6a636ef49c77b8120b41ce3f6376ef6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65714,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_005502ce7fa29afa09aa47cd3c4d96ba.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55906,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_fcdbb43b4b63edb8a6a4598202d1bf4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_aa660a89-4cff-55f1-9861-d70f588c35b3/aa660a89-4cff-55f1-9861-d70f588c35b3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67495,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/50/c95001ee66f422bdb17f8403b658d209/pa/GY98380_5b057478f0f59291921c49edcaa3043e.jpg',
'Width': 800}],
'postal_code': '65024',
'price': 0,
'price_includes_vat': True,
'province': 'Pescara',
'province_code': 'IT-PE',
'region': 'Abruzzi',
'region_code': 'IT-01',
'registration_date': '2017-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Range Rover Sport 3.0 V6 TDI HSE Dynamic',
'transmission': 'automatic',
'trim': 'HSE Dynamic',
'year': 2017}
2026-04-27 08:03:37 [auto1.it] INFO: Saving data for GY98380: {'created_time': 1777277017.044028, 'last_price_update_time': 1777277017.044039, 'has_photos': True, 'auction_closing_time': 1777391234.0}
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_65a0c1d68b6cb727314827ea9a7c6fd5.jpg not downloaded yet
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56adf90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6d155f45ad89f99d756c5fb11a99ca26.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487790>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dde90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d
2026-04-27 08:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d, skipping ID generation
2026-04-27 08:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with scrape type 1
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d6224d1-2a5b-5f43-a3e4-ff06578f698d sending to next pipeline
2026-04-27 08:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d, identifier: LR68259
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_8926580a97c3ba33644437b021611c15.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-04-27 08:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259
2026-04-27 08:03:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d6224d1-2a5b-5f43-a3e4-ff06578f698d with identifier: LR68259 to the API
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Capannori',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 72,
'expiration_date': '2026-04-28T15:57:57Z',
'fuel_type': 'petrol',
'id': '0d6224d1-2a5b-5f43-a3e4-ff06578f698d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR68259',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Toyota',
'model': 'Aygo X',
'odometer': 31275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84934,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_523031ee1b7fb70beea74818887b27a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82552,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_8ec45243856c2516dab175892126b4c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81227,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_112d711e90c7e3ff00a2048226a0d973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_7b758fea3a2a0e2f6ce34032d75279db.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_bcd875a92198728227af70a3da2a964f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_e4fbad55a2f522f63c1915e1e647177b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_37d3ff74cc7ee5ad43e250150424e91e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87300,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_89a51aab0e0de5e54f7f053710d3986b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_c5e6501157e5ca54b3e9e63fc4b1e6c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d6224d1-2a5b-5f43-a3e4-ff06578f698d/0d6224d1-2a5b-5f43-a3e4-ff06578f698d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76034,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/e3/3ee39e4325c78e16aa50dee295acdaa1/pa/LR68259_f6c3a4cb6e862654ad2ed9a8f7258a3f.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2022-11-27',
'seats_number': 4,
'seller_name': None,
'title': 'Toyota Aygo X 1.0 Trendy',
'transmission': 'automatic',
'trim': 'Trendy',
'year': 2022}
2026-04-27 08:03:37 [auto1.it] INFO: Saving data for LR68259: {'created_time': 1777277017.637284, 'last_price_update_time': 1777277017.637297, 'has_photos': True, 'auction_closing_time': 1777391877.0}
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_038419573696d6e345c7abd5a963a89d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_f02177659ecf5d656b494c55f3674bd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_7eda5fd11f6259dd4af9c1e6726b9409.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_38c347ef6b46220ba97e04b487a1c04a.jpg not downloaded yet
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB58973/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MM75159/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_25bbf5920ff5fa431b4c465d180636b3.jpg not downloaded yet
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_7df73067032d73d66cf21c7250769755.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_45786d2cabdb3d4a37224595ea4a9d7d.jpg not downloaded yet
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_4d6504613120c5ab3a60a3411477c0f9.jpg not downloaded yet
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725d190>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_038419573696d6e345c7abd5a963a89d.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6387a90>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_f02177659ecf5d656b494c55f3674bd1.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead632ab10>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_7eda5fd11f6259dd4af9c1e6726b9409.jpg saved to cache
2026-04-27 08:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_65a0c1d68b6cb727314827ea9a7c6fd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_8926580a97c3ba33644437b021611c15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_1d9e106af83b1b1ddc88ef08772f60c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_38c347ef6b46220ba97e04b487a1c04a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2b710>
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_65a0c1d68b6cb727314827ea9a7c6fd5.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f7f50>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_8926580a97c3ba33644437b021611c15.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5334b50>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_1d9e106af83b1b1ddc88ef08772f60c7.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_45786d2cabdb3d4a37224595ea4a9d7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5558b50>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_38c347ef6b46220ba97e04b487a1c04a.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_4d6504613120c5ab3a60a3411477c0f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead581b090>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_45786d2cabdb3d4a37224595ea4a9d7d.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563eb50>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_4d6504613120c5ab3a60a3411477c0f9.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_7df73067032d73d66cf21c7250769755.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_25bbf5920ff5fa431b4c465d180636b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5336910>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_7df73067032d73d66cf21c7250769755.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55bea50>
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_25bbf5920ff5fa431b4c465d180636b3.jpg saved to cache
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60ae398f-e974-5d88-becd-4b2f3809f826
2026-04-27 08:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60ae398f-e974-5d88-becd-4b2f3809f826, skipping ID generation
2026-04-27 08:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60ae398f-e974-5d88-becd-4b2f3809f826 with scrape type 1
2026-04-27 08:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60ae398f-e974-5d88-becd-4b2f3809f826 sending to next pipeline
2026-04-27 08:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 60ae398f-e974-5d88-becd-4b2f3809f826, identifier: MJ42614
2026-04-27 08:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-04-27 08:03:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-04-27 08:03:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-04-27 08:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614
2026-04-27 08:03:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 60ae398f-e974-5d88-becd-4b2f3809f826 with identifier: MJ42614 to the API
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_25bbf5920ff5fa431b4c465d180636b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'Settimo Torinese',
'color': 'beige',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:24:24Z',
'fuel_type': 'petrol',
'id': '60ae398f-e974-5d88-becd-4b2f3809f826',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MJ42614',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'T-Cross',
'odometer': 14260,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_038419573696d6e345c7abd5a963a89d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_f02177659ecf5d656b494c55f3674bd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_1d9e106af83b1b1ddc88ef08772f60c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53288,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_65a0c1d68b6cb727314827ea9a7c6fd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_8926580a97c3ba33644437b021611c15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70216,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_38c347ef6b46220ba97e04b487a1c04a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_25bbf5920ff5fa431b4c465d180636b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58169,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_7df73067032d73d66cf21c7250769755.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_45786d2cabdb3d4a37224595ea4a9d7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_60ae398f-e974-5d88-becd-4b2f3809f826/60ae398f-e974-5d88-becd-4b2f3809f826_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59447,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/3d/f43df43494bed5d61c5bba64f18769c7/pa/MJ42614_4d6504613120c5ab3a60a3411477c0f9.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2024-01-28',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Cross 1.0 TSI Style',
'transmission': 'manual',
'trim': 'Style',
'year': 2024}
2026-04-27 08:03:39 [auto1.it] INFO: Saving data for MJ42614: {'created_time': 1777277019.328327, 'last_price_update_time': 1777277019.328337, 'has_photos': True, 'auction_closing_time': 1777389864.0}
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6acfacca92172949f9ed9af7736c7057.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WN90008/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_fb51c4d1e7936ca83e964f46fdee9be6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a34d0>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6acfacca92172949f9ed9af7736c7057.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_40d7bda19ea6b7ec34e16e7994523208.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA15878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563e410>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_fb51c4d1e7936ca83e964f46fdee9be6.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5940910>
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_40d7bda19ea6b7ec34e16e7994523208.jpg saved to cache
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 717b69a6-4363-561b-8fac-ad2d9a5471bb
2026-04-27 08:03:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 717b69a6-4363-561b-8fac-ad2d9a5471bb, skipping ID generation
2026-04-27 08:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 717b69a6-4363-561b-8fac-ad2d9a5471bb with scrape type 1
2026-04-27 08:03:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 717b69a6-4363-561b-8fac-ad2d9a5471bb sending to next pipeline
2026-04-27 08:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 717b69a6-4363-561b-8fac-ad2d9a5471bb, identifier: GB46284
2026-04-27 08:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 717b69a6-4363-561b-8fac-ad2d9a5471bb with identifier: GB46284
2026-04-27 08:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 717b69a6-4363-561b-8fac-ad2d9a5471bb with identifier: GB46284
2026-04-27 08:03:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 717b69a6-4363-561b-8fac-ad2d9a5471bb with identifier: GB46284 to the API
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_40d7bda19ea6b7ec34e16e7994523208.jpg>
{'auction_title': '',
'c_o_2_emission_value': 129,
'category': None,
'city': 'Varedo',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.2L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:57:47Z',
'fuel_type': 'petrol',
'id': '717b69a6-4363-561b-8fac-ad2d9a5471bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB46284',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Hyundai',
'model': 'i20',
'odometer': 9548,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_fb51c4d1e7936ca83e964f46fdee9be6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58143,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_40d7bda19ea6b7ec34e16e7994523208.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70629,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_e214668c74d183ae21f3704e2e47e2d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6acfacca92172949f9ed9af7736c7057.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71517,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_7eda5fd11f6259dd4af9c1e6726b9409.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77712,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_483e18f8052e7dedc5108c1cf1986fdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_6d155f45ad89f99d756c5fb11a99ca26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_0a9bcf786ec08678bbf8c51407d66738.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_d912e7b2344807f27b1fd418556f7545.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_717b69a6-4363-561b-8fac-ad2d9a5471bb/717b69a6-4363-561b-8fac-ad2d9a5471bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55980,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9e/23/9e23ece7aef5c595bffe33386a9a0de1/pa/GB46284_ba8b33b67b8e9617d0f90fbb6934cab3.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2019-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i20 1.2 Tech ISG',
'transmission': 'manual',
'trim': 'Tech ISG',
'year': 2019}
2026-04-27 08:03:40 [auto1.it] INFO: Saving data for GB46284: {'created_time': 1777277020.121574, 'last_price_update_time': 1777277020.121586, 'has_photos': True, 'auction_closing_time': 1777391867.0}
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TN35413/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH93132/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.516(s), this was the 1st time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.30022065962293 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.526(s), this was the 1st time calling it.
2026-04-27 08:03:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.336992026131539 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NN80859/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MM75159> (referer: https://www.auto1.com/v1/car-details-view/MM75159/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZW61080/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef0340cd-e315-5a63-b3d1-873afd94866f with identifier: MM75159
2026-04-27 08:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0340cd-e315-5a63-b3d1-873afd94866f with scrape type 1
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b0cf4c834f1e041b4f970d27579becde.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_249ecd67907f6e977fad4112984a3683.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_95a8deeef9b27352e1444dd7e09cd5b6.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_9aeb524e6fbfe7396198a414870eedec.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_368cdda197eae807c9de6da9f0aa3bc5.jpg not downloaded yet
2026-04-27 08:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b6391c57a3197e12c0b8a05fea7b4f80.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_740e72e4b8ab1af3c045e9f10de7cea0.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_1f07ce2d287103db7e69479b969d7db9.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XT85815/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_59f43106f5a03587959a48f45cffb054.jpg not downloaded yet
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_0ee824ab0dc02ed19cd95848752f45cb.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_1f07ce2d287103db7e69479b969d7db9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5335790>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_1f07ce2d287103db7e69479b969d7db9.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CH87663> (referer: https://www.auto1.com/v1/car-details-view/CH87663/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_0ee824ab0dc02ed19cd95848752f45cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 131fc068-4ed7-568d-89a8-f495fd61dda0 with identifier: CH87663
2026-04-27 08:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131fc068-4ed7-568d-89a8-f495fd61dda0 with scrape type 1
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_881157b24d1d727a327e912d73d98876.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_964cd9667075635df9b2ea76937284ab.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_59f43106f5a03587959a48f45cffb054.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_6d94c02b9c28d4926bc38c36bd9de76c.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_893fea5e60ceefc029f3faaf6cad8028.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_790d66748d118d4b3b2be7be6df32386.jpg not downloaded yet
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad390>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_0ee824ab0dc02ed19cd95848752f45cb.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_b2f9281d2221d421ecf4b5b0ea6a67df.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_a8624deacfd0c0538d60b2686c0ac0bf.jpg not downloaded yet
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_e06fd5b97213fe92d75dea0ddd229a27.jpg not downloaded yet
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664d50>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_59f43106f5a03587959a48f45cffb054.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_95db711882985a3cd73e1f4732eacbab.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_964cd9667075635df9b2ea76937284ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_514c57710c663c0f194a5cb16a488369.jpg not downloaded yet
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_e06fd5b97213fe92d75dea0ddd229a27.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59350d0>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_964cd9667075635df9b2ea76937284ab.jpg saved to cache
2026-04-27 08:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YM08087/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53369d0>
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_e06fd5b97213fe92d75dea0ddd229a27.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_514c57710c663c0f194a5cb16a488369.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_95db711882985a3cd73e1f4732eacbab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664250>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_514c57710c663c0f194a5cb16a488369.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_a8624deacfd0c0538d60b2686c0ac0bf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5960590>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_95db711882985a3cd73e1f4732eacbab.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667010>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_a8624deacfd0c0538d60b2686c0ac0bf.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_b2f9281d2221d421ecf4b5b0ea6a67df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_790d66748d118d4b3b2be7be6df32386.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a19d0>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_b2f9281d2221d421ecf4b5b0ea6a67df.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_893fea5e60ceefc029f3faaf6cad8028.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ff50>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_790d66748d118d4b3b2be7be6df32386.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a3d10>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_893fea5e60ceefc029f3faaf6cad8028.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_6d94c02b9c28d4926bc38c36bd9de76c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_881157b24d1d727a327e912d73d98876.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d810>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_6d94c02b9c28d4926bc38c36bd9de76c.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64856d0>
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_881157b24d1d727a327e912d73d98876.jpg saved to cache
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 131fc068-4ed7-568d-89a8-f495fd61dda0
2026-04-27 08:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 131fc068-4ed7-568d-89a8-f495fd61dda0, skipping ID generation
2026-04-27 08:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 131fc068-4ed7-568d-89a8-f495fd61dda0 with scrape type 1
2026-04-27 08:03:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 131fc068-4ed7-568d-89a8-f495fd61dda0 sending to next pipeline
2026-04-27 08:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 131fc068-4ed7-568d-89a8-f495fd61dda0, identifier: CH87663
2026-04-27 08:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 131fc068-4ed7-568d-89a8-f495fd61dda0 with identifier: CH87663
2026-04-27 08:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 131fc068-4ed7-568d-89a8-f495fd61dda0 with identifier: CH87663
2026-04-27 08:03:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 131fc068-4ed7-568d-89a8-f495fd61dda0 with identifier: CH87663 to the API
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_881157b24d1d727a327e912d73d98876.jpg>
{'auction_title': '',
'c_o_2_emission_value': 102,
'category': None,
'city': 'Milano',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:51:19Z',
'fuel_type': 'diesel',
'id': '131fc068-4ed7-568d-89a8-f495fd61dda0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH87663',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Citroen',
'model': 'C4 Grand Picasso',
'odometer': 184806,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_881157b24d1d727a327e912d73d98876.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_964cd9667075635df9b2ea76937284ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65853,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_6d94c02b9c28d4926bc38c36bd9de76c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_893fea5e60ceefc029f3faaf6cad8028.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_790d66748d118d4b3b2be7be6df32386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_b2f9281d2221d421ecf4b5b0ea6a67df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_a8624deacfd0c0538d60b2686c0ac0bf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71610,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_e06fd5b97213fe92d75dea0ddd229a27.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67787,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_95db711882985a3cd73e1f4732eacbab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_131fc068-4ed7-568d-89a8-f495fd61dda0/131fc068-4ed7-568d-89a8-f495fd61dda0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59283,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/1a/5e1a85403454269e88bfbcdcfb9c8410/pa/CH87663_514c57710c663c0f194a5cb16a488369.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-01-19',
'seats_number': 7,
'seller_name': None,
'title': 'Citroen C4 Grand Picasso 2.0 Blue-HDi Intensive',
'transmission': 'manual',
'trim': 'Intensive',
'year': 2015}
2026-04-27 08:03:51 [auto1.it] INFO: Saving data for CH87663: {'created_time': 1777277031.393205, 'last_price_update_time': 1777277031.393219, 'has_photos': True, 'auction_closing_time': 1777391479.0}
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB58973> (referer: https://www.auto1.com/v1/car-details-view/EB58973/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-04-27 08:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 with scrape type 1
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_740e72e4b8ab1af3c045e9f10de7cea0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LF46608> (referer: https://www.auto1.com/v1/car-details-view/LF46608/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg not downloaded yet
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57aca10>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_740e72e4b8ab1af3c045e9f10de7cea0.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4246640-59f9-5647-a430-3ba076f66964 with identifier: LF46608
2026-04-27 08:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4246640-59f9-5647-a430-3ba076f66964 with scrape type 1
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_c0e8e10ca53a394b042dacc9c5ca3e12.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_1f8a84ba583aef93bba0aa003bf79e56.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_257fd78813389830be5ac0d97de76001.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_d26f29e7f96b286ea3f829f70638c663.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4b52556d3320403e2cfc779e3fcdd639.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_27b9ae790d5d6dad333fb5f2e1c590dc.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_3a47c8d48d7957d111c7b1e5460590b8.jpg not downloaded yet
2026-04-27 08:03:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_0453ea28ff3b21cd5266800fb5e1b944.jpg not downloaded yet
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4010ab0c3ec8849ff7d19e5df6e2d6d3.jpg not downloaded yet
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_873c8c4c047d26a4b0ed9be8e55c77ea.jpg not downloaded yet
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d59d0>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg saved to cache
2026-04-27 08:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4010ab0c3ec8849ff7d19e5df6e2d6d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c2a10>
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_257fd78813389830be5ac0d97de76001.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a3d50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4010ab0c3ec8849ff7d19e5df6e2d6d3.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_0453ea28ff3b21cd5266800fb5e1b944.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f5d90>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_257fd78813389830be5ac0d97de76001.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_873c8c4c047d26a4b0ed9be8e55c77ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c1f10>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_0453ea28ff3b21cd5266800fb5e1b944.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_27b9ae790d5d6dad333fb5f2e1c590dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53357d0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_873c8c4c047d26a4b0ed9be8e55c77ea.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_3a47c8d48d7957d111c7b1e5460590b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4b52556d3320403e2cfc779e3fcdd639.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563cc50>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_27b9ae790d5d6dad333fb5f2e1c590dc.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_d26f29e7f96b286ea3f829f70638c663.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_1f8a84ba583aef93bba0aa003bf79e56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587efd0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_3a47c8d48d7957d111c7b1e5460590b8.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5592110>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4b52556d3320403e2cfc779e3fcdd639.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_c0e8e10ca53a394b042dacc9c5ca3e12.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d4750>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_d26f29e7f96b286ea3f829f70638c663.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5962010>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_1f8a84ba583aef93bba0aa003bf79e56.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59609d0>
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_c0e8e10ca53a394b042dacc9c5ca3e12.jpg saved to cache
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4246640-59f9-5647-a430-3ba076f66964
2026-04-27 08:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4246640-59f9-5647-a430-3ba076f66964, skipping ID generation
2026-04-27 08:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4246640-59f9-5647-a430-3ba076f66964 with scrape type 1
2026-04-27 08:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4246640-59f9-5647-a430-3ba076f66964 sending to next pipeline
2026-04-27 08:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: b4246640-59f9-5647-a430-3ba076f66964, identifier: LF46608
2026-04-27 08:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b4246640-59f9-5647-a430-3ba076f66964 with identifier: LF46608
2026-04-27 08:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b4246640-59f9-5647-a430-3ba076f66964 with identifier: LF46608
2026-04-27 08:03:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b4246640-59f9-5647-a430-3ba076f66964 with identifier: LF46608 to the API
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_c0e8e10ca53a394b042dacc9c5ca3e12.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': 'Rental',
'city': 'Varedo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:09:37Z',
'fuel_type': 'diesel',
'id': 'b4246640-59f9-5647-a430-3ba076f66964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF46608',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 145090,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73544,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_c0e8e10ca53a394b042dacc9c5ca3e12.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72335,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_1f8a84ba583aef93bba0aa003bf79e56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_257fd78813389830be5ac0d97de76001.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67702,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_d26f29e7f96b286ea3f829f70638c663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60199,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4b52556d3320403e2cfc779e3fcdd639.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_27b9ae790d5d6dad333fb5f2e1c590dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60209,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_3a47c8d48d7957d111c7b1e5460590b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72157,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_0453ea28ff3b21cd5266800fb5e1b944.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74869,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_4010ab0c3ec8849ff7d19e5df6e2d6d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b4246640-59f9-5647-a430-3ba076f66964/b4246640-59f9-5647-a430-3ba076f66964_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/3f/3e3f8ce0384503e4c4b6af88e0a88623/pa/LF46608_873c8c4c047d26a4b0ed9be8e55c77ea.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2015-09-16',
'seats_number': 6,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion BlueMotion Tech',
'year': 2015}
2026-04-27 08:03:53 [auto1.it] INFO: Saving data for LF46608: {'created_time': 1777277033.279301, 'last_price_update_time': 1777277033.279313, 'has_photos': True, 'auction_closing_time': 1777388977.0}
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DC14157> (referer: https://www.auto1.com/v1/car-details-view/DC14157/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TN35413> (referer: https://www.auto1.com/v1/car-details-view/TN35413/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e310>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5590990>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f4bd0>
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg saved to cache
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [auto1.it] INFO: Channel: 24h | Page: 9 | totalHits: 3130 | hits on page: 40
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c511151-0d4c-51b0-a9a7-147f7cf03238 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-04-27 08:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with scrape type 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_883de941e44239dd741e6cd4a8d6f21d.jpg not downloaded yet
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: JB66719
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for JB66719: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: ZC15371
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for ZC15371: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: TD68261
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for TD68261: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: YU29433
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for YU29433: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: RE51399
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for RE51399: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: WY26414
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for WY26414: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: XB11924
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for XB11924: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: GT34435
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for GT34435: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: WZ30101
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for WZ30101: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: FP12220
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for FP12220: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: JD11535
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for JD11535: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: HB10468
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for HB10468: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: BN85160
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for BN85160: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: YB68272
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for YB68272: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: BD69591
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for BD69591: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: XP72573
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for XP72573: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: VD09142
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for VD09142: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: SJ15806
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for SJ15806: 0
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: PJ86967
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for PJ86967: 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg not downloaded yet
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b27c21a6b219483cfd78909fa650d890.jpg not downloaded yet
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b6391c57a3197e12c0b8a05fea7b4f80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_9aeb524e6fbfe7396198a414870eedec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_368cdda197eae807c9de6da9f0aa3bc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:53 [auto1.it] INFO: Found listing with ID: NK66633
2026-04-27 08:03:53 [auto1.it] INFO: Scrape type for NK66633: 1
2026-04-27 08:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_536cec561ad66fd110b1235611726b4a.jpg not downloaded yet
2026-04-27 08:03:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577af10>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a0fc90>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58642d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:54 [auto1.it] INFO: Found listing with ID: ES07755
2026-04-27 08:03:54 [auto1.it] INFO: Scrape type for ES07755: 1
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_a86f2e4e2c87e982ffcee714e0f93fd9.jpg not downloaded yet
2026-04-27 08:03:54 [auto1.it] INFO: Found listing with ID: YK93703
2026-04-27 08:03:54 [auto1.it] INFO: Scrape type for YK93703: 1
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg not downloaded yet
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_06771c1046a0edfad7e64ddca65d9ddb.jpg not downloaded yet
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a4b7d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53945d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b6391c57a3197e12c0b8a05fea7b4f80.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c0590>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_9aeb524e6fbfe7396198a414870eedec.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6482110>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_368cdda197eae807c9de6da9f0aa3bc5.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59682d0>
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg saved to cache
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8fbfba57-3031-5043-bf96-7654e89d6ce0
2026-04-27 08:03:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8fbfba57-3031-5043-bf96-7654e89d6ce0, skipping ID generation
2026-04-27 08:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 with scrape type 1
2026-04-27 08:03:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8fbfba57-3031-5043-bf96-7654e89d6ce0 sending to next pipeline
2026-04-27 08:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8fbfba57-3031-5043-bf96-7654e89d6ce0, identifier: EB58973
2026-04-27 08:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-04-27 08:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973
2026-04-27 08:03:54 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8fbfba57-3031-5043-bf96-7654e89d6ce0 with identifier: EB58973 to the API
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:03:54 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:01:32Z',
'fuel_type': 'diesel',
'id': '8fbfba57-3031-5043-bf96-7654e89d6ce0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB58973',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'Golf VII',
'odometer': 141986,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82738,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_69371794c3dac706d64ab35247842559.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_97824676ff8f38db098bf4bf7b34cbe1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_2d9405c831fab16439eda933ed35accf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_57f13357aac8686d8183120379aae445.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_8f28161c76cd4cd730b011f4f13a95d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_7e4675cd2e83f1c18f18249e742c71d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_ab2537c6c76b2a6b7df0f12be1ca9bcc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_225a9bf48f463318e7e383f47d99fdac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_897a2ac450c9384b5c1368b962b44b92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8fbfba57-3031-5043-bf96-7654e89d6ce0/8fbfba57-3031-5043-bf96-7654e89d6ce0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc9/16/c91622e2ba21869a56b5e09a58de8e14/pa/EB58973_205c219908a2bd21394ff6d0256e4a05.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2015-03-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VII 1.6 TDI Trendline BlueMotion Tech',
'transmission': 'manual',
'trim': 'Trendline BlueMotion Tech',
'year': 2015}
2026-04-27 08:03:55 [auto1.it] INFO: Saving data for EB58973: {'created_time': 1777277035.014295, 'last_price_update_time': 1777277035.014305, 'has_photos': True, 'auction_closing_time': 1777388492.0}
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: SE74727
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for SE74727: 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9ee8bf362ff5fcc746f3c3bd10be553d.jpg not downloaded yet
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_883de941e44239dd741e6cd4a8d6f21d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b27c21a6b219483cfd78909fa650d890.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YT13161/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: KZ67108
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for KZ67108: 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9d29d2bbc579599bb847fa077c465d00.jpg not downloaded yet
2026-04-27 08:03:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: RE95163
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for RE95163: 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b25d005d7ae42f2a4983dd6cfb2d616b.jpg not downloaded yet
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6447290>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_a86f2e4e2c87e982ffcee714e0f93fd9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: GS36896
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for GS36896: 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_22fe96d64db0b8c034f27727076f00a6.jpg not downloaded yet
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_06771c1046a0edfad7e64ddca65d9ddb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56b3250>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721f550>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_883de941e44239dd741e6cd4a8d6f21d.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5887e10>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b27c21a6b219483cfd78909fa650d890.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: PP32682
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for PP32682: 1
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg not downloaded yet
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_59d4f028b12de7f5a7e3322e497ea168.jpg not downloaded yet
2026-04-27 08:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9ee8bf362ff5fcc746f3c3bd10be553d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:55 [auto1.it] INFO: Found listing with ID: HN68081
2026-04-27 08:03:55 [auto1.it] INFO: Scrape type for HN68081: 1
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552e510>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_a86f2e4e2c87e982ffcee714e0f93fd9.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ff650>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg saved to cache
2026-04-27 08:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a519d0>
2026-04-27 08:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_06771c1046a0edfad7e64ddca65d9ddb.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: ST44628
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for ST44628: 1
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b25d005d7ae42f2a4983dd6cfb2d616b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721fa50>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9ee8bf362ff5fcc746f3c3bd10be553d.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: DT30257
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for DT30257: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: YJ48407
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for YJ48407: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: VC24858
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for VC24858: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: YN82579
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for YN82579: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: UM88538
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for UM88538: 1
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f4ad0>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b25d005d7ae42f2a4983dd6cfb2d616b.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: GX58945
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for GX58945: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: LX14349
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for LX14349: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: JH44016
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for JH44016: 1
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5666410>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_59d4f028b12de7f5a7e3322e497ea168.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: VL69252
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for VL69252: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: KZ49625
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for KZ49625: 1
2026-04-27 08:03:56 [auto1.it] INFO: Found listing with ID: FU36199
2026-04-27 08:03:56 [auto1.it] INFO: Scrape type for FU36199: 1
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f5d50>
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_59d4f028b12de7f5a7e3322e497ea168.jpg saved to cache
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH93132> (referer: https://www.auto1.com/v1/car-details-view/JH93132/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with identifier: JH93132
2026-04-27 08:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with scrape type 1
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_b38645d4d97077439d83edbefb042500.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_29a746090158b36493f1f87770906321.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_822f687094f27dd1fb10278d1fdb22ad.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_03375022acc92e0afca6fd39ead2d88f.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_640402cb65a173df78e632029434032d.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_da93805338711fbd29bb2abb4cedda2e.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_e89dad0ef1f825c112e1b1c99c51e9e2.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_dda92f1315de731ab636a12d34b3b8e7.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_3bd587b4bacac65154ff15b7ec590790.jpg not downloaded yet
2026-04-27 08:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_1505b33489213bcb532ca51e985b8792.jpg not downloaded yet
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XT85815> (referer: https://www.auto1.com/v1/car-details-view/XT85815/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_1505b33489213bcb532ca51e985b8792.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with identifier: XT85815
2026-04-27 08:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with scrape type 1
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_eb47d7608f0616a51ab5cedb4de2b1d0.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_2eba67f94eb46c8132a48fa6b27f57df.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4750b5ab8f6d1873ec8319f7f5d1e7f7.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_8da7054b53a41e202b34f43cdc7a52be.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4a88582b3ef7572909439695f9e039e4.jpg not downloaded yet
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647f90>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_1505b33489213bcb532ca51e985b8792.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_49ec6bf2f1cfd18c9a3c51ba36783bdb.jpg not downloaded yet
2026-04-27 08:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_3bd587b4bacac65154ff15b7ec590790.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_bf9cb9dc3fe2e9df949491e8a9a1d5f2.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_e8800f82d3ac22d1ef5d66d6b9bddb50.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_6b418b9cf1b59c7b802fa055537d295b.jpg not downloaded yet
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_004aee2d643b4035e8d33be970d53fd0.jpg not downloaded yet
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae5408550>
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_3bd587b4bacac65154ff15b7ec590790.jpg saved to cache
2026-04-27 08:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4a88582b3ef7572909439695f9e039e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c6a50>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4a88582b3ef7572909439695f9e039e4.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_004aee2d643b4035e8d33be970d53fd0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5951b50>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_004aee2d643b4035e8d33be970d53fd0.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_6b418b9cf1b59c7b802fa055537d295b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_e8800f82d3ac22d1ef5d66d6b9bddb50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5511d50>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_6b418b9cf1b59c7b802fa055537d295b.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a97090>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_e8800f82d3ac22d1ef5d66d6b9bddb50.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_bf9cb9dc3fe2e9df949491e8a9a1d5f2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_49ec6bf2f1cfd18c9a3c51ba36783bdb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f5610>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_bf9cb9dc3fe2e9df949491e8a9a1d5f2.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649fc90>
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_49ec6bf2f1cfd18c9a3c51ba36783bdb.jpg saved to cache
2026-04-27 08:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_8da7054b53a41e202b34f43cdc7a52be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59528d0>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_8da7054b53a41e202b34f43cdc7a52be.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4750b5ab8f6d1873ec8319f7f5d1e7f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555dd50>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4750b5ab8f6d1873ec8319f7f5d1e7f7.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_2eba67f94eb46c8132a48fa6b27f57df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_eb47d7608f0616a51ab5cedb4de2b1d0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487450>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_2eba67f94eb46c8132a48fa6b27f57df.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555e310>
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:03:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_eb47d7608f0616a51ab5cedb4de2b1d0.jpg saved to cache
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead
2026-04-27 08:03:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead, skipping ID generation
2026-04-27 08:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with scrape type 1
2026-04-27 08:03:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead sending to next pipeline
2026-04-27 08:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead, identifier: XT85815
2026-04-27 08:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with identifier: XT85815
2026-04-27 08:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with identifier: XT85815
2026-04-27 08:04:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead with identifier: XT85815 to the API
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_eb47d7608f0616a51ab5cedb4de2b1d0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Reggio Emilia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:12:30Z',
'fuel_type': 'diesel',
'id': '8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XT85815',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 187917,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_eb47d7608f0616a51ab5cedb4de2b1d0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81362,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_2eba67f94eb46c8132a48fa6b27f57df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78122,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4750b5ab8f6d1873ec8319f7f5d1e7f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70218,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_8da7054b53a41e202b34f43cdc7a52be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73347,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_4a88582b3ef7572909439695f9e039e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74027,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_49ec6bf2f1cfd18c9a3c51ba36783bdb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_bf9cb9dc3fe2e9df949491e8a9a1d5f2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_e8800f82d3ac22d1ef5d66d6b9bddb50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_6b418b9cf1b59c7b802fa055537d295b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead/8f5a5c6f-bbb7-5b7e-a2ae-e4f7b27d6ead_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64720,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img29/1b/291b4f77a7c26bed519fdc6751478cd4/pa/XT85815_004aee2d643b4035e8d33be970d53fd0.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2016-05-15',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 1.7 CRDi Comfort ISG 2WD',
'transmission': 'manual',
'trim': 'Comfort ISG 2WD',
'year': 2016}
2026-04-27 08:04:00 [auto1.it] INFO: Saving data for XT85815: {'created_time': 1777277040.354096, 'last_price_update_time': 1777277040.354108, 'has_photos': True, 'auction_closing_time': 1777389150.0}
2026-04-27 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_dda92f1315de731ab636a12d34b3b8e7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f6690>
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_dda92f1315de731ab636a12d34b3b8e7.jpg saved to cache
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_e89dad0ef1f825c112e1b1c99c51e9e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7110>
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_e89dad0ef1f825c112e1b1c99c51e9e2.jpg saved to cache
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_da93805338711fbd29bb2abb4cedda2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55128d0>
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_da93805338711fbd29bb2abb4cedda2e.jpg saved to cache
2026-04-27 08:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_640402cb65a173df78e632029434032d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_03375022acc92e0afca6fd39ead2d88f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a96010>
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_640402cb65a173df78e632029434032d.jpg saved to cache
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f58d0>
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_03375022acc92e0afca6fd39ead2d88f.jpg saved to cache
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_822f687094f27dd1fb10278d1fdb22ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f75d0>
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_822f687094f27dd1fb10278d1fdb22ad.jpg saved to cache
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_29a746090158b36493f1f87770906321.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_b38645d4d97077439d83edbefb042500.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762710>
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_29a746090158b36493f1f87770906321.jpg saved to cache
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486dd0>
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_b38645d4d97077439d83edbefb042500.jpg saved to cache
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a
2026-04-27 08:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a, skipping ID generation
2026-04-27 08:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with scrape type 1
2026-04-27 08:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 089ab3bf-3176-50c7-bc25-bfb0121c2f9a sending to next pipeline
2026-04-27 08:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a, identifier: JH93132
2026-04-27 08:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with identifier: JH93132
2026-04-27 08:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with identifier: JH93132
2026-04-27 08:04:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 089ab3bf-3176-50c7-bc25-bfb0121c2f9a with identifier: JH93132 to the API
2026-04-27 08:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_b38645d4d97077439d83edbefb042500.jpg>
{'auction_title': '',
'c_o_2_emission_value': 137,
'category': None,
'city': 'Senago',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:36:06Z',
'fuel_type': 'diesel',
'id': '089ab3bf-3176-50c7-bc25-bfb0121c2f9a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH93132',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Nissan',
'model': 'Qashqai',
'odometer': 209666,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_b38645d4d97077439d83edbefb042500.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_29a746090158b36493f1f87770906321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_822f687094f27dd1fb10278d1fdb22ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45096,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_03375022acc92e0afca6fd39ead2d88f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_640402cb65a173df78e632029434032d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_da93805338711fbd29bb2abb4cedda2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_e89dad0ef1f825c112e1b1c99c51e9e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_dda92f1315de731ab636a12d34b3b8e7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_3bd587b4bacac65154ff15b7ec590790.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_089ab3bf-3176-50c7-bc25-bfb0121c2f9a/089ab3bf-3176-50c7-bc25-bfb0121c2f9a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74746,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgaf/21/af21f02e109bc0bfc8269693ed410a93/pa/JH93132_1505b33489213bcb532ca51e985b8792.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2012-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Nissan Qashqai 1.5 Turbodiesel Acenta',
'transmission': 'manual',
'trim': 'Acenta',
'year': 2012}
2026-04-27 08:04:02 [auto1.it] INFO: Saving data for JH93132: {'created_time': 1777277042.1409, 'last_price_update_time': 1777277042.140911, 'has_photos': True, 'auction_closing_time': 1777390566.0}
2026-04-27 08:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ME27860> (referer: https://www.auto1.com/v1/car-details-view/ME27860/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-04-27 08:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11116e8-744f-56f3-a329-6a95fc21f4fe with scrape type 1
2026-04-27 08:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg not downloaded yet
2026-04-27 08:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg not downloaded yet
2026-04-27 08:04:10 [scrapy.extensions.logstats] INFO: Crawled 486 pages (at 46 pages/min), scraped 203 items (at 25 items/min)
2026-04-27 08:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZW61080> (referer: https://www.auto1.com/v1/car-details-view/ZW61080/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e171201-dd5a-5ba1-9065-e62cc213658e with identifier: ZW61080
2026-04-27 08:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e171201-dd5a-5ba1-9065-e62cc213658e with scrape type 1
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_23fcb376880b31991a43c7b9d654695e.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_7ca8b575d24a9024ed4a67e4d73648c8.jpg not downloaded yet
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_ae37ee1eac09fe9357ff4140da6a55bc.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_06ca8835224ee37df7cca4a35b03df7b.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_fb6c000a507b189166862ab5d205eea4.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_95d15e7647c1edf06146ad83242144d2.jpg not downloaded yet
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f79d0>
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg saved to cache
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_5ab88d959cce0c0944e7783dd3c445d1.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_624404e4254122db403354d9e28902b5.jpg not downloaded yet
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_cc09d8543df575b5e49efa6d1e49a114.jpg not downloaded yet
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fee50>
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg saved to cache
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_22fc1682d5f64ca46c46bf32e5d02845.jpg not downloaded yet
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_7ca8b575d24a9024ed4a67e4d73648c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_22fc1682d5f64ca46c46bf32e5d02845.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58143d0>
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_7ca8b575d24a9024ed4a67e4d73648c8.jpg saved to cache
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_cc09d8543df575b5e49efa6d1e49a114.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58169d0>
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_22fc1682d5f64ca46c46bf32e5d02845.jpg saved to cache
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f6210>
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_cc09d8543df575b5e49efa6d1e49a114.jpg saved to cache
2026-04-27 08:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_624404e4254122db403354d9e28902b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a96650>
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_624404e4254122db403354d9e28902b5.jpg saved to cache
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_5ab88d959cce0c0944e7783dd3c445d1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59630d0>
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_5ab88d959cce0c0944e7783dd3c445d1.jpg saved to cache
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_95d15e7647c1edf06146ad83242144d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817750>
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_95d15e7647c1edf06146ad83242144d2.jpg saved to cache
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_fb6c000a507b189166862ab5d205eea4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563cdd0>
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_fb6c000a507b189166862ab5d205eea4.jpg saved to cache
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_06ca8835224ee37df7cca4a35b03df7b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6bd0>
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_06ca8835224ee37df7cca4a35b03df7b.jpg saved to cache
2026-04-27 08:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_ae37ee1eac09fe9357ff4140da6a55bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_23fcb376880b31991a43c7b9d654695e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c53d0>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_ae37ee1eac09fe9357ff4140da6a55bc.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f55d0>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_23fcb376880b31991a43c7b9d654695e.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3e171201-dd5a-5ba1-9065-e62cc213658e
2026-04-27 08:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e171201-dd5a-5ba1-9065-e62cc213658e, skipping ID generation
2026-04-27 08:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e171201-dd5a-5ba1-9065-e62cc213658e with scrape type 1
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3e171201-dd5a-5ba1-9065-e62cc213658e sending to next pipeline
2026-04-27 08:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3e171201-dd5a-5ba1-9065-e62cc213658e, identifier: ZW61080
2026-04-27 08:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3e171201-dd5a-5ba1-9065-e62cc213658e with identifier: ZW61080
2026-04-27 08:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3e171201-dd5a-5ba1-9065-e62cc213658e with identifier: ZW61080
2026-04-27 08:04:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3e171201-dd5a-5ba1-9065-e62cc213658e with identifier: ZW61080 to the API
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_23fcb376880b31991a43c7b9d654695e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:08:27Z',
'fuel_type': 'diesel',
'id': '3e171201-dd5a-5ba1-9065-e62cc213658e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZW61080',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Jeep',
'model': 'Compass',
'odometer': 18142,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_23fcb376880b31991a43c7b9d654695e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_7ca8b575d24a9024ed4a67e4d73648c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_ae37ee1eac09fe9357ff4140da6a55bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_06ca8835224ee37df7cca4a35b03df7b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_fb6c000a507b189166862ab5d205eea4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_95d15e7647c1edf06146ad83242144d2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94922,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_5ab88d959cce0c0944e7783dd3c445d1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_624404e4254122db403354d9e28902b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_cc09d8543df575b5e49efa6d1e49a114.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3e171201-dd5a-5ba1-9065-e62cc213658e/3e171201-dd5a-5ba1-9065-e62cc213658e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81103,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfc/aa/fcaa7774154dd05740ba558fd12c826e/pa/ZW61080_22fc1682d5f64ca46c46bf32e5d02845.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2021-04-29',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Compass 1.6 M-Jet Longitude FWD',
'transmission': 'manual',
'trim': 'Longitude FWD',
'year': 2021}
2026-04-27 08:04:16 [auto1.it] INFO: Saving data for ZW61080: {'created_time': 1777277056.756824, 'last_price_update_time': 1777277056.756834, 'has_photos': True, 'auction_closing_time': 1777388907.0}
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK93703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c5ad0>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b290>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483910>
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg saved to cache
2026-04-27 08:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564ecd0>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2a9d0>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d890>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5509310>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fe190>
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg saved to cache
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a11116e8-744f-56f3-a329-6a95fc21f4fe
2026-04-27 08:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a11116e8-744f-56f3-a329-6a95fc21f4fe, skipping ID generation
2026-04-27 08:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11116e8-744f-56f3-a329-6a95fc21f4fe with scrape type 1
2026-04-27 08:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a11116e8-744f-56f3-a329-6a95fc21f4fe sending to next pipeline
2026-04-27 08:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: a11116e8-744f-56f3-a329-6a95fc21f4fe, identifier: ME27860
2026-04-27 08:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-04-27 08:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860
2026-04-27 08:04:17 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: a11116e8-744f-56f3-a329-6a95fc21f4fe with identifier: ME27860 to the API
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:17 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg>
{'auction_title': '',
'c_o_2_emission_value': 200,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '4.0L',
'engine_horse_power': 470,
'expiration_date': '2026-04-28T15:57:06Z',
'fuel_type': 'petrol',
'id': 'a11116e8-744f-56f3-a329-6a95fc21f4fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ME27860',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Mercedes-Benz',
'model': 'S-Klasse',
'odometer': 119390,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61379,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_2115c708bd73d2cc528ffdb06e0c02be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57514,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_ea82d7908cb3b780464e2bb7ff8acd09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_07495f91f1bff6267171c45ecdd1481a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_5e7430417c61cfc6d7d11b052c7df979.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6ad04e25608e5812780e41eed4dc5ebb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_e8d7f93f93ebc595280c94f03fad7894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54082,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_8f8b8707e8a38fe3c2132b06dddbdde3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_599e49295f9ca41323fea58954110ac2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_52a2901219fb849b28bb8a6759cb840b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_a11116e8-744f-56f3-a329-6a95fc21f4fe/a11116e8-744f-56f3-a329-6a95fc21f4fe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/9f/ab9ff8d93f1498f2dbe462335bf121e5/pa/ME27860_6db2b09a2958a4e7becee4e488d81812.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2018-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz S-Klasse S 560 4Matic Premium Plus',
'transmission': 'automatic',
'trim': '4Matic Premium Plus',
'year': 2018}
2026-04-27 08:04:17 [auto1.it] INFO: Saving data for ME27860: {'created_time': 1777277057.710349, 'last_price_update_time': 1777277057.710362, 'has_photos': True, 'auction_closing_time': 1777391826.0}
2026-04-27 08:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RE95163/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YM08087> (referer: https://www.auto1.com/v1/car-details-view/YM08087/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HN68081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 279e556d-e915-56a8-86cf-c8e10f3ad388 with identifier: YM08087
2026-04-27 08:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 279e556d-e915-56a8-86cf-c8e10f3ad388 with scrape type 1
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_03356dedb2cadee2d8f3fd3c47c28adb.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_a9ed310a47e94c0f76f3302772c27f98.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_84aaa053c9d8f23e3983668f5c730594.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e87326bf923540f753f0a770cfeae555.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_85a2bbf97c85ee43ecffb207b31e4aae.jpg not downloaded yet
2026-04-27 08:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_d40984f72a7becba177f517de5e1e87c.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_ec34376d35ee1ee9775c319eb4f0227e.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_905fe756ad184aff9deb7863ff8997be.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e4490de5b8a172d8389d72a800e7bf14.jpg not downloaded yet
2026-04-27 08:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_311c1462530f9139fd37a805e9827f46.jpg not downloaded yet
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST44628/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_311c1462530f9139fd37a805e9827f46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563f450>
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_311c1462530f9139fd37a805e9827f46.jpg saved to cache
2026-04-27 08:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA21297/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e4490de5b8a172d8389d72a800e7bf14.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5768fd0>
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e4490de5b8a172d8389d72a800e7bf14.jpg saved to cache
2026-04-27 08:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ49625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_905fe756ad184aff9deb7863ff8997be.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5644f90>
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_905fe756ad184aff9deb7863ff8997be.jpg saved to cache
2026-04-27 08:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WN90008> (referer: https://www.auto1.com/v1/car-details-view/WN90008/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae07a557-b6aa-5325-af4c-54d1336dbda4 with identifier: WN90008
2026-04-27 08:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae07a557-b6aa-5325-af4c-54d1336dbda4 with scrape type 1
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_9bc7a4689383a77c86689ec1bc4f1821.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_c2d5684b06b9dfea34812c9bf53e022d.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_17f12b276fabac2ebd1dcfb8e30439d6.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_8d0da9b59483d883a50075f0c441c318.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_5fc958635ad37cf4cffa8542ba07db92.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_d4f929712ecbe232d07b4250e66bceff.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_48831bf58ff8131c0e7f6be065c294b5.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f3f8903a4028938beb9029f26e060df6.jpg not downloaded yet
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_ddc568717d3b71e7b19766c936187d3f.jpg not downloaded yet
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VL69252/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f25bdda036fe38cc78020b629e9f2ec7.jpg not downloaded yet
2026-04-27 08:04:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_ec34376d35ee1ee9775c319eb4f0227e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f25bdda036fe38cc78020b629e9f2ec7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576ab10>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_ec34376d35ee1ee9775c319eb4f0227e.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_ddc568717d3b71e7b19766c936187d3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f77d0>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f25bdda036fe38cc78020b629e9f2ec7.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59500d0>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_ddc568717d3b71e7b19766c936187d3f.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f3f8903a4028938beb9029f26e060df6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725d250>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f3f8903a4028938beb9029f26e060df6.jpg saved to cache
2026-04-27 08:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_48831bf58ff8131c0e7f6be065c294b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769ad0>
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_48831bf58ff8131c0e7f6be065c294b5.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_d4f929712ecbe232d07b4250e66bceff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5592250>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_d4f929712ecbe232d07b4250e66bceff.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_5fc958635ad37cf4cffa8542ba07db92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559c250>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_5fc958635ad37cf4cffa8542ba07db92.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_8d0da9b59483d883a50075f0c441c318.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483910>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_8d0da9b59483d883a50075f0c441c318.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_17f12b276fabac2ebd1dcfb8e30439d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_c2d5684b06b9dfea34812c9bf53e022d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559f210>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_17f12b276fabac2ebd1dcfb8e30439d6.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA15878> (referer: https://www.auto1.com/v1/car-details-view/AA15878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_9bc7a4689383a77c86689ec1bc4f1821.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5481fd0>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_c2d5684b06b9dfea34812c9bf53e022d.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-04-27 08:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with scrape type 1
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg not downloaded yet
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg not downloaded yet
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg not downloaded yet
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c4790>
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_9bc7a4689383a77c86689ec1bc4f1821.jpg saved to cache
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae07a557-b6aa-5325-af4c-54d1336dbda4
2026-04-27 08:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae07a557-b6aa-5325-af4c-54d1336dbda4, skipping ID generation
2026-04-27 08:04:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae07a557-b6aa-5325-af4c-54d1336dbda4 with scrape type 1
2026-04-27 08:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae07a557-b6aa-5325-af4c-54d1336dbda4 sending to next pipeline
2026-04-27 08:04:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae07a557-b6aa-5325-af4c-54d1336dbda4, identifier: WN90008
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae07a557-b6aa-5325-af4c-54d1336dbda4 with identifier: WN90008
2026-04-27 08:04:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae07a557-b6aa-5325-af4c-54d1336dbda4 with identifier: WN90008
2026-04-27 08:04:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae07a557-b6aa-5325-af4c-54d1336dbda4 with identifier: WN90008 to the API
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_9bc7a4689383a77c86689ec1bc4f1821.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:32:18Z',
'fuel_type': 'diesel',
'id': 'ae07a557-b6aa-5325-af4c-54d1336dbda4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN90008',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Fiat',
'model': 'Fiorino',
'odometer': 43265,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77762,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_9bc7a4689383a77c86689ec1bc4f1821.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_c2d5684b06b9dfea34812c9bf53e022d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63247,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_17f12b276fabac2ebd1dcfb8e30439d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50821,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_8d0da9b59483d883a50075f0c441c318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_5fc958635ad37cf4cffa8542ba07db92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_d4f929712ecbe232d07b4250e66bceff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_48831bf58ff8131c0e7f6be065c294b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76155,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f3f8903a4028938beb9029f26e060df6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_ddc568717d3b71e7b19766c936187d3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae07a557-b6aa-5325-af4c-54d1336dbda4/ae07a557-b6aa-5325-af4c-54d1336dbda4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img61/28/6128035193619d6b3dfb8f58c7429774/pa/WN90008_f25bdda036fe38cc78020b629e9f2ec7.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2023-05-29',
'seats_number': 2,
'seller_name': None,
'title': 'Fiat Fiorino 1.3 M-Jet SX Kasten',
'transmission': 'manual',
'trim': 'SX Kasten',
'year': 2023}
2026-04-27 08:04:28 [auto1.it] INFO: Saving data for WN90008: {'created_time': 1777277068.62128, 'last_price_update_time': 1777277068.621293, 'has_photos': True, 'auction_closing_time': 1777390338.0}
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_d40984f72a7becba177f517de5e1e87c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_85a2bbf97c85ee43ecffb207b31e4aae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg not downloaded yet
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg not downloaded yet
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555ee50>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_d40984f72a7becba177f517de5e1e87c.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594dc90>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_85a2bbf97c85ee43ecffb207b31e4aae.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3e990>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg saved to cache
2026-04-27 08:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a973d0>
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564d750>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564db90>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e910>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815ed0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6dd0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c7510>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5210>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e87326bf923540f753f0a770cfeae555.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PJ86967/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59511d0>
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg saved to cache
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045
2026-04-27 08:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d269d9d-7d8c-5312-9b48-2d559ebdf045, skipping ID generation
2026-04-27 08:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with scrape type 1
2026-04-27 08:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d269d9d-7d8c-5312-9b48-2d559ebdf045 sending to next pipeline
2026-04-27 08:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d269d9d-7d8c-5312-9b48-2d559ebdf045, identifier: AA15878
2026-04-27 08:04:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-04-27 08:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878
2026-04-27 08:04:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d269d9d-7d8c-5312-9b48-2d559ebdf045 with identifier: AA15878 to the API
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Bentivoglio',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.3L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:49:16Z',
'fuel_type': 'diesel',
'id': '9d269d9d-7d8c-5312-9b48-2d559ebdf045',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6369,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA15878',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'location_confidence': 'geocoded',
'longitude': 11.4174,
'make': 'Mitsubishi',
'model': 'Outlander',
'odometer': 102381,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8c409b05c8149f9cc1a32aad28ae0bc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74622,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96e3201c7d67c22c55f2bd0d226cf98d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68030,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_7b670973900c0639cc41e06023e1f2c8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_ae50c2c0b42001b7182b55ef8a4b3805.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_e1c193f450d19c7f51ae94754b08e95c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_8b0d33cd50f9bc83de049a778e6bf2ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66076,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_6afa8b815d3a18fcc400c9ab128ed2a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_96d860c88bd7bc878a0981a57c32070b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68996,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_cda3054cacc042307dc4182163574a0a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d269d9d-7d8c-5312-9b48-2d559ebdf045/9d269d9d-7d8c-5312-9b48-2d559ebdf045_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57925,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/26/742675c8d7c26f9686ba8305a440a650/pa/AA15878_3edcf53f98a45f3fcdaf27f9d93311f3.jpg',
'Width': 800}],
'postal_code': '40010',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2017-10-16',
'seats_number': 7,
'seller_name': None,
'title': 'Mitsubishi Outlander 2.2 DI-D Insport ClearTec 2WD',
'transmission': 'manual',
'trim': 'Insport ClearTec 2WD',
'year': 2017}
2026-04-27 08:04:30 [auto1.it] INFO: Saving data for AA15878: {'created_time': 1777277070.233995, 'last_price_update_time': 1777277070.234007, 'has_photos': True, 'auction_closing_time': 1777391356.0}
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953d90>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e87326bf923540f753f0a770cfeae555.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_84aaa053c9d8f23e3983668f5c730594.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_a9ed310a47e94c0f76f3302772c27f98.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29a90>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_84aaa053c9d8f23e3983668f5c730594.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_03356dedb2cadee2d8f3fd3c47c28adb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649d3d0>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_a9ed310a47e94c0f76f3302772c27f98.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3ee50>
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_03356dedb2cadee2d8f3fd3c47c28adb.jpg saved to cache
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 279e556d-e915-56a8-86cf-c8e10f3ad388
2026-04-27 08:04:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 279e556d-e915-56a8-86cf-c8e10f3ad388, skipping ID generation
2026-04-27 08:04:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 279e556d-e915-56a8-86cf-c8e10f3ad388 with scrape type 1
2026-04-27 08:04:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 279e556d-e915-56a8-86cf-c8e10f3ad388 sending to next pipeline
2026-04-27 08:04:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 279e556d-e915-56a8-86cf-c8e10f3ad388, identifier: YM08087
2026-04-27 08:04:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 279e556d-e915-56a8-86cf-c8e10f3ad388 with identifier: YM08087
2026-04-27 08:04:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 279e556d-e915-56a8-86cf-c8e10f3ad388 with identifier: YM08087
2026-04-27 08:04:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 279e556d-e915-56a8-86cf-c8e10f3ad388 with identifier: YM08087 to the API
2026-04-27 08:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:31 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_03356dedb2cadee2d8f3fd3c47c28adb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:51:14Z',
'fuel_type': 'diesel',
'id': '279e556d-e915-56a8-86cf-c8e10f3ad388',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YM08087',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 346309,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81262,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_03356dedb2cadee2d8f3fd3c47c28adb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_a9ed310a47e94c0f76f3302772c27f98.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80019,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_84aaa053c9d8f23e3983668f5c730594.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e87326bf923540f753f0a770cfeae555.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79251,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_85a2bbf97c85ee43ecffb207b31e4aae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72465,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_d40984f72a7becba177f517de5e1e87c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54109,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_ec34376d35ee1ee9775c319eb4f0227e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_905fe756ad184aff9deb7863ff8997be.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_e4490de5b8a172d8389d72a800e7bf14.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_279e556d-e915-56a8-86cf-c8e10f3ad388/279e556d-e915-56a8-86cf-c8e10f3ad388_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82250,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img76/05/76056cf0c61eddba8e4d349e4c5172d8/pa/YM08087_311c1462530f9139fd37a805e9827f46.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2018-10-30',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2018}
2026-04-27 08:04:31 [auto1.it] INFO: Saving data for YM08087: {'created_time': 1777277071.446782, 'last_price_update_time': 1777277071.446792, 'has_photos': True, 'auction_closing_time': 1777391474.0}
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FU36199/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LX14349/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UM88538/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST44628> (referer: https://www.auto1.com/v1/car-details-view/ST44628/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK93703> (referer: https://www.auto1.com/v1/car-details-view/YK93703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with identifier: ST44628
2026-04-27 08:04:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with scrape type 1
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_114e2b2d1883c9729f84590b92ef4da8.jpg not downloaded yet
2026-04-27 08:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_7976e712ba6f01ccb728010411562d21.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_a05967956837aecd93ebc5d63008eb66.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_bb55f1b57841a9e790a91c892c1971dc.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b302419cffcd50cb1bae27a7dc63c868.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with identifier: YK93703
2026-04-27 08:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with scrape type 1
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_4c25dd754eea35b87c00c70520a49a45.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_5d7015ddfcf7798dcefa53d27878699f.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_5a42d4e1464495e9ab523f7792b80df7.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_941815b697ce0b0a5c2252a9df1025c4.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_aa96e4db226841410e0027a23e87e9bb.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b927536cd6026dc30cb3aa5f5924627a.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_8633254c6ff8b65d4366f414bc802a18.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_20c54159726fe71bf0d88984378e0b71.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_c90a56240e19797d9d12278145b85976.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_90d7877e5135e2b2f1bcf5b3f5aa8c1b.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA21297> (referer: https://www.auto1.com/v1/car-details-view/DA21297/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-04-27 08:04:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd89628b-94ab-5a0e-b25b-ac4e03788838 with scrape type 1
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_1960cdd13084cb9425a03df01921d686.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c70b5a481c5cec8f7d41ab8cbfae4536.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c377e8f50ac8f8f73ab8249a8f898ca3.jpg not downloaded yet
2026-04-27 08:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c84a8864874178f2a294c82c9a66e357.jpg not downloaded yet
2026-04-27 08:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_90d7877e5135e2b2f1bcf5b3f5aa8c1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_fa0f680e250d4f4b71357afbe34cbf09.jpg not downloaded yet
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_90b5e557390e4a2d694f93aca749cde0.jpg not downloaded yet
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d8d0>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_90d7877e5135e2b2f1bcf5b3f5aa8c1b.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c84a8864874178f2a294c82c9a66e357.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_90b5e557390e4a2d694f93aca749cde0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5593d50>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c84a8864874178f2a294c82c9a66e357.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5646d10>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_90b5e557390e4a2d694f93aca749cde0.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_fa0f680e250d4f4b71357afbe34cbf09.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6484f90>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_fa0f680e250d4f4b71357afbe34cbf09.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c377e8f50ac8f8f73ab8249a8f898ca3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563c950>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c377e8f50ac8f8f73ab8249a8f898ca3.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c70b5a481c5cec8f7d41ab8cbfae4536.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6610>
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c70b5a481c5cec8f7d41ab8cbfae4536.jpg saved to cache
2026-04-27 08:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_1960cdd13084cb9425a03df01921d686.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_c90a56240e19797d9d12278145b85976.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f7290>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_1960cdd13084cb9425a03df01921d686.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd89628b-94ab-5a0e-b25b-ac4e03788838
2026-04-27 08:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd89628b-94ab-5a0e-b25b-ac4e03788838, skipping ID generation
2026-04-27 08:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd89628b-94ab-5a0e-b25b-ac4e03788838 with scrape type 1
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd89628b-94ab-5a0e-b25b-ac4e03788838 sending to next pipeline
2026-04-27 08:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd89628b-94ab-5a0e-b25b-ac4e03788838, identifier: DA21297
2026-04-27 08:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-04-27 08:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297
2026-04-27 08:04:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd89628b-94ab-5a0e-b25b-ac4e03788838 with identifier: DA21297 to the API
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_1960cdd13084cb9425a03df01921d686.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Varedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 102,
'expiration_date': '2026-04-28T15:46:47Z',
'fuel_type': 'gas',
'id': 'dd89628b-94ab-5a0e-b25b-ac4e03788838',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA21297',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Volkswagen',
'model': 'Golf VI',
'odometer': 304349,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_1960cdd13084cb9425a03df01921d686.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c70b5a481c5cec8f7d41ab8cbfae4536.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c377e8f50ac8f8f73ab8249a8f898ca3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_c84a8864874178f2a294c82c9a66e357.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_fa0f680e250d4f4b71357afbe34cbf09.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd89628b-94ab-5a0e-b25b-ac4e03788838/dd89628b-94ab-5a0e-b25b-ac4e03788838_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60491,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgae/a2/aea2f73e64da9fe9af62ee86d50e33c1/pa/DA21297_90b5e557390e4a2d694f93aca749cde0.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2011-05-04',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Golf VI 1.6 BIFuel Comfortline',
'transmission': 'manual',
'trim': 'Comfortline',
'year': 2011}
2026-04-27 08:04:36 [auto1.it] INFO: Saving data for DA21297: {'created_time': 1777277076.768398, 'last_price_update_time': 1777277076.76841, 'has_photos': True, 'auction_closing_time': 1777391207.0}
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_20c54159726fe71bf0d88984378e0b71.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f6d10>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_c90a56240e19797d9d12278145b85976.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af350>
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_20c54159726fe71bf0d88984378e0b71.jpg saved to cache
2026-04-27 08:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_8633254c6ff8b65d4366f414bc802a18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769a50>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_8633254c6ff8b65d4366f414bc802a18.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b927536cd6026dc30cb3aa5f5924627a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a94c50>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b927536cd6026dc30cb3aa5f5924627a.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_aa96e4db226841410e0027a23e87e9bb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95390>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_aa96e4db226841410e0027a23e87e9bb.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_941815b697ce0b0a5c2252a9df1025c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_5a42d4e1464495e9ab523f7792b80df7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649f5d0>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_941815b697ce0b0a5c2252a9df1025c4.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559c950>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_5a42d4e1464495e9ab523f7792b80df7.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_5d7015ddfcf7798dcefa53d27878699f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_4c25dd754eea35b87c00c70520a49a45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65fb750>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_5d7015ddfcf7798dcefa53d27878699f.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563c310>
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_4c25dd754eea35b87c00c70520a49a45.jpg saved to cache
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae
2026-04-27 08:04:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae, skipping ID generation
2026-04-27 08:04:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with scrape type 1
2026-04-27 08:04:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34cf494b-8ca3-51c1-bcfd-3b3c975373ae sending to next pipeline
2026-04-27 08:04:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae, identifier: YK93703
2026-04-27 08:04:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with identifier: YK93703
2026-04-27 08:04:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with identifier: YK93703
2026-04-27 08:04:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 34cf494b-8ca3-51c1-bcfd-3b3c975373ae with identifier: YK93703 to the API
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_4c25dd754eea35b87c00c70520a49a45.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Desenzano Del Garda',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:57:28Z',
'fuel_type': 'diesel',
'id': '34cf494b-8ca3-51c1-bcfd-3b3c975373ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4713,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK93703',
'listing': 'auction',
'location': 'IT, Desenzano del Garda',
'location_confidence': 'geocoded',
'longitude': 10.5356,
'make': 'Opel',
'model': 'Astra',
'odometer': 311042,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_4c25dd754eea35b87c00c70520a49a45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62743,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_5a42d4e1464495e9ab523f7792b80df7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65559,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_aa96e4db226841410e0027a23e87e9bb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79069,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_8633254c6ff8b65d4366f414bc802a18.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_34cf494b-8ca3-51c1-bcfd-3b3c975373ae/34cf494b-8ca3-51c1-bcfd-3b3c975373ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58119,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img33/c6/33c6b0a1e5c5167ad09beb68dc0dd82d/pa/YK93703_c90a56240e19797d9d12278145b85976.jpg',
'Width': 800}],
'postal_code': '25015',
'price': 0,
'price_includes_vat': True,
'province': 'Brescia',
'province_code': 'IT-BS',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2012-11-26',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2012}
2026-04-27 08:04:38 [auto1.it] INFO: Saving data for YK93703: {'created_time': 1777277078.362338, 'last_price_update_time': 1777277078.362349, 'has_photos': True, 'auction_closing_time': 1777391848.0}
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b302419cffcd50cb1bae27a7dc63c868.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487710>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b302419cffcd50cb1bae27a7dc63c868.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_bb55f1b57841a9e790a91c892c1971dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a96b50>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_bb55f1b57841a9e790a91c892c1971dc.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_a05967956837aecd93ebc5d63008eb66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f6890>
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_a05967956837aecd93ebc5d63008eb66.jpg saved to cache
2026-04-27 08:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_7976e712ba6f01ccb728010411562d21.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_114e2b2d1883c9729f84590b92ef4da8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649e550>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_7976e712ba6f01ccb728010411562d21.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3e650>
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_114e2b2d1883c9729f84590b92ef4da8.jpg saved to cache
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a
2026-04-27 08:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a, skipping ID generation
2026-04-27 08:04:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with scrape type 1
2026-04-27 08:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a sending to next pipeline
2026-04-27 08:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a, identifier: ST44628
2026-04-27 08:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with identifier: ST44628
2026-04-27 08:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with identifier: ST44628
2026-04-27 08:04:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a with identifier: ST44628 to the API
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_114e2b2d1883c9729f84590b92ef4da8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:53:51Z',
'fuel_type': 'petrol',
'id': 'ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST44628',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Citroen',
'model': 'C3',
'odometer': 105027,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_114e2b2d1883c9729f84590b92ef4da8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_7976e712ba6f01ccb728010411562d21.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56650,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_a05967956837aecd93ebc5d63008eb66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52383,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_bb55f1b57841a9e790a91c892c1971dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52735,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b302419cffcd50cb1bae27a7dc63c868.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51400,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_5d7015ddfcf7798dcefa53d27878699f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_941815b697ce0b0a5c2252a9df1025c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_b927536cd6026dc30cb3aa5f5924627a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65968,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_20c54159726fe71bf0d88984378e0b71.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a/ef16b4d2-ebe3-5a87-bde1-9fb9fbf43b2a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img0a/c1/0ac131dd3cb11b733e47b44a86e14ade/pa/ST44628_90d7877e5135e2b2f1bcf5b3f5aa8c1b.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2017-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen C3 1.2 PureTech Shine',
'transmission': 'automatic',
'trim': 'Shine',
'year': 2017}
2026-04-27 08:04:39 [auto1.it] INFO: Saving data for ST44628: {'created_time': 1777277079.634818, 'last_price_update_time': 1777277079.634828, 'has_photos': True, 'auction_closing_time': 1777391631.0}
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VL69252> (referer: https://www.auto1.com/v1/car-details-view/VL69252/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with identifier: VL69252
2026-04-27 08:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with scrape type 1
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_0322faa61cae58cbf20fba44477b05fd.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4cdb71834017c77341c01af52477856e.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4d9a0c372d68e35be92c92fd93dcedef.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_178928f7fbd1f72812e38fe45f4613a4.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_062eb28ba1f6076ab5ac51a0f07ae160.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_874e017a683deeaa701cca11fe6c16a5.jpg not downloaded yet
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dd390>
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg saved to cache
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_fdb49d0f4d9421cf8ea89547b4b284d8.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_a5c7246351c376880857ae537b89e0cb.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_b3c302a330abf1cdac5798e0067de53f.jpg not downloaded yet
2026-04-27 08:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_f2b98cfbaeba2e3cb78849854e0667e2.jpg not downloaded yet
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ49625> (referer: https://www.auto1.com/v1/car-details-view/KZ49625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_f2b98cfbaeba2e3cb78849854e0667e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37ee94e8-b167-54e8-af2f-2102596c19bb with identifier: KZ49625
2026-04-27 08:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ee94e8-b167-54e8-af2f-2102596c19bb with scrape type 1
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_10955b806e2e7b599575d84ef9e98e57.jpg not downloaded yet
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_e2e0867844ab60af6ca3b29763dbe976.jpg not downloaded yet
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_b3c302a330abf1cdac5798e0067de53f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_9fb4a0c483b5fa660a9adf3ea04e25f5.jpg not downloaded yet
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fc381d44bda8e8daadc6b8a78c9ff37b.jpg not downloaded yet
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_a3b6b71f89d859e615dc2208d4bab26e.jpg not downloaded yet
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fd250>
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_f2b98cfbaeba2e3cb78849854e0667e2.jpg saved to cache
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_8b972c4e66207fdfd2c1cb8e18130d41.jpg not downloaded yet
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_e2e0867844ab60af6ca3b29763dbe976.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fa1b6ba2c96ebb133ed29e6ba4a5b11a.jpg not downloaded yet
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550b6d0>
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_b3c302a330abf1cdac5798e0067de53f.jpg saved to cache
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_285a947cee2ff9862c04c60706f59c07.jpg not downloaded yet
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_2ee189fc069b721d41bfabb8998e4828.jpg not downloaded yet
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_765520d599cca4ad041407b40d7ef4c3.jpg not downloaded yet
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649d490>
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_e2e0867844ab60af6ca3b29763dbe976.jpg saved to cache
2026-04-27 08:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_8b972c4e66207fdfd2c1cb8e18130d41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_765520d599cca4ad041407b40d7ef4c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5968b90>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_8b972c4e66207fdfd2c1cb8e18130d41.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_2ee189fc069b721d41bfabb8998e4828.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e810>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_765520d599cca4ad041407b40d7ef4c3.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555ea50>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_2ee189fc069b721d41bfabb8998e4828.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_285a947cee2ff9862c04c60706f59c07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1df50>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_285a947cee2ff9862c04c60706f59c07.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fa1b6ba2c96ebb133ed29e6ba4a5b11a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_a3b6b71f89d859e615dc2208d4bab26e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53386d0>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fa1b6ba2c96ebb133ed29e6ba4a5b11a.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fc381d44bda8e8daadc6b8a78c9ff37b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555f090>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_a3b6b71f89d859e615dc2208d4bab26e.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_9fb4a0c483b5fa660a9adf3ea04e25f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649ebd0>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fc381d44bda8e8daadc6b8a78c9ff37b.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_10955b806e2e7b599575d84ef9e98e57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5646d50>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_9fb4a0c483b5fa660a9adf3ea04e25f5.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_a5c7246351c376880857ae537b89e0cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c1d0>
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_10955b806e2e7b599575d84ef9e98e57.jpg saved to cache
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37ee94e8-b167-54e8-af2f-2102596c19bb
2026-04-27 08:04:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37ee94e8-b167-54e8-af2f-2102596c19bb, skipping ID generation
2026-04-27 08:04:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37ee94e8-b167-54e8-af2f-2102596c19bb with scrape type 1
2026-04-27 08:04:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37ee94e8-b167-54e8-af2f-2102596c19bb sending to next pipeline
2026-04-27 08:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 37ee94e8-b167-54e8-af2f-2102596c19bb, identifier: KZ49625
2026-04-27 08:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 37ee94e8-b167-54e8-af2f-2102596c19bb with identifier: KZ49625
2026-04-27 08:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 37ee94e8-b167-54e8-af2f-2102596c19bb with identifier: KZ49625
2026-04-27 08:04:46 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 37ee94e8-b167-54e8-af2f-2102596c19bb with identifier: KZ49625 to the API
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_10955b806e2e7b599575d84ef9e98e57.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:03:18Z',
'fuel_type': 'diesel',
'id': '37ee94e8-b167-54e8-af2f-2102596c19bb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ49625',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'BMW',
'model': '3er',
'odometer': 185286,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79944,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_10955b806e2e7b599575d84ef9e98e57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82105,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_e2e0867844ab60af6ca3b29763dbe976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_9fb4a0c483b5fa660a9adf3ea04e25f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69041,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fc381d44bda8e8daadc6b8a78c9ff37b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_a3b6b71f89d859e615dc2208d4bab26e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_8b972c4e66207fdfd2c1cb8e18130d41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_fa1b6ba2c96ebb133ed29e6ba4a5b11a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_285a947cee2ff9862c04c60706f59c07.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75701,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_2ee189fc069b721d41bfabb8998e4828.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_37ee94e8-b167-54e8-af2f-2102596c19bb/37ee94e8-b167-54e8-af2f-2102596c19bb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf5/d3/f5d3fdfb9f22404f196f9c627c2f644d/pa/KZ49625_765520d599cca4ad041407b40d7ef4c3.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2015-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 3er 318d GT',
'transmission': 'manual',
'trim': '',
'year': 2015}
2026-04-27 08:04:46 [auto1.it] INFO: Saving data for KZ49625: {'created_time': 1777277086.527872, 'last_price_update_time': 1777277086.527881, 'has_photos': True, 'auction_closing_time': 1777388598.0}
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_fdb49d0f4d9421cf8ea89547b4b284d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1f910>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_a5c7246351c376880857ae537b89e0cb.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_874e017a683deeaa701cca11fe6c16a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f4390>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_fdb49d0f4d9421cf8ea89547b4b284d8.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d690>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_874e017a683deeaa701cca11fe6c16a5.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_062eb28ba1f6076ab5ac51a0f07ae160.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_178928f7fbd1f72812e38fe45f4613a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e810>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_062eb28ba1f6076ab5ac51a0f07ae160.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7790>
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_178928f7fbd1f72812e38fe45f4613a4.jpg saved to cache
2026-04-27 08:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4d9a0c372d68e35be92c92fd93dcedef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4cdb71834017c77341c01af52477856e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d6d0>
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4d9a0c372d68e35be92c92fd93dcedef.jpg saved to cache
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_0322faa61cae58cbf20fba44477b05fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56447d0>
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4cdb71834017c77341c01af52477856e.jpg saved to cache
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647090>
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_0322faa61cae58cbf20fba44477b05fd.jpg saved to cache
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f
2026-04-27 08:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f, skipping ID generation
2026-04-27 08:04:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with scrape type 1
2026-04-27 08:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bed3d2ed-ee4f-575f-8be7-e09cc293ab8f sending to next pipeline
2026-04-27 08:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f, identifier: VL69252
2026-04-27 08:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with identifier: VL69252
2026-04-27 08:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with identifier: VL69252
2026-04-27 08:04:47 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bed3d2ed-ee4f-575f-8be7-e09cc293ab8f with identifier: VL69252 to the API
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:04:47 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_0322faa61cae58cbf20fba44477b05fd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 146,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 230,
'expiration_date': '2026-04-28T15:43:52Z',
'fuel_type': 'diesel',
'id': 'bed3d2ed-ee4f-575f-8be7-e09cc293ab8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL69252',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'BMW',
'model': 'X5',
'odometer': 151432,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69967,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_0322faa61cae58cbf20fba44477b05fd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63127,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4cdb71834017c77341c01af52477856e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64467,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_4d9a0c372d68e35be92c92fd93dcedef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_178928f7fbd1f72812e38fe45f4613a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_062eb28ba1f6076ab5ac51a0f07ae160.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_874e017a683deeaa701cca11fe6c16a5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_fdb49d0f4d9421cf8ea89547b4b284d8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_a5c7246351c376880857ae537b89e0cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67292,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_b3c302a330abf1cdac5798e0067de53f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bed3d2ed-ee4f-575f-8be7-e09cc293ab8f/bed3d2ed-ee4f-575f-8be7-e09cc293ab8f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2d/88/2d88a648e8c66ef2b95b10eef96e2856/pa/VL69252_f2b98cfbaeba2e3cb78849854e0667e2.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2018-09-27',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-04-27 08:04:47 [auto1.it] INFO: Saving data for VL69252: {'created_time': 1777277087.741216, 'last_price_update_time': 1777277087.741228, 'has_photos': True, 'auction_closing_time': 1777391032.0}
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GX58945/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_22fe96d64db0b8c034f27727076f00a6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5951850>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_22fe96d64db0b8c034f27727076f00a6.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5645910>
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:04:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg saved to cache
2026-04-27 08:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VC24858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YN82579/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YJ48407/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LX14349> (referer: https://www.auto1.com/v1/car-details-view/LX14349/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:04:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-04-27 08:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 with scrape type 1
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg not downloaded yet
2026-04-27 08:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg not downloaded yet
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FU36199> (referer: https://www.auto1.com/v1/car-details-view/FU36199/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a7786a1-a639-501f-aef5-6be09c7403bc with identifier: FU36199
2026-04-27 08:05:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7786a1-a639-501f-aef5-6be09c7403bc with scrape type 1
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_be81421814b081b3df8dfda38e199dc0.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_21edaf3f32384e3653cd2aa26abcc985.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_a8d74d0a5575784d961d30f022c79973.jpg not downloaded yet
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_54cfee11690daafd51fc602883a8b87c.jpg not downloaded yet
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_c9c5b966730c109204f7e94ffa2b20ce.jpg not downloaded yet
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ee50>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_a8d74d0a5575784d961d30f022c79973.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555fd10>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_a8d74d0a5575784d961d30f022c79973.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_c9c5b966730c109204f7e94ffa2b20ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54afdd0>
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_c9c5b966730c109204f7e94ffa2b20ce.jpg saved to cache
2026-04-27 08:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_54cfee11690daafd51fc602883a8b87c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5a90>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_54cfee11690daafd51fc602883a8b87c.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_21edaf3f32384e3653cd2aa26abcc985.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_be81421814b081b3df8dfda38e199dc0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5646c90>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_21edaf3f32384e3653cd2aa26abcc985.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555fcd0>
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_be81421814b081b3df8dfda38e199dc0.jpg saved to cache
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0a7786a1-a639-501f-aef5-6be09c7403bc
2026-04-27 08:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0a7786a1-a639-501f-aef5-6be09c7403bc, skipping ID generation
2026-04-27 08:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a7786a1-a639-501f-aef5-6be09c7403bc with scrape type 1
2026-04-27 08:05:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0a7786a1-a639-501f-aef5-6be09c7403bc sending to next pipeline
2026-04-27 08:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0a7786a1-a639-501f-aef5-6be09c7403bc, identifier: FU36199
2026-04-27 08:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0a7786a1-a639-501f-aef5-6be09c7403bc with identifier: FU36199
2026-04-27 08:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0a7786a1-a639-501f-aef5-6be09c7403bc with identifier: FU36199
2026-04-27 08:05:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0a7786a1-a639-501f-aef5-6be09c7403bc with identifier: FU36199 to the API
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:01 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_be81421814b081b3df8dfda38e199dc0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 128,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.5L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:35:24Z',
'fuel_type': 'diesel',
'id': '0a7786a1-a639-501f-aef5-6be09c7403bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU36199',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Renault',
'model': 'Scenic',
'odometer': 292766,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95780,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_be81421814b081b3df8dfda38e199dc0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86115,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_21edaf3f32384e3653cd2aa26abcc985.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81391,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_a8d74d0a5575784d961d30f022c79973.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80598,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_54cfee11690daafd51fc602883a8b87c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0a7786a1-a639-501f-aef5-6be09c7403bc/0a7786a1-a639-501f-aef5-6be09c7403bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47455,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3e/05/3e05b124fcedc42748be439dff17cb07/pa/FU36199_c9c5b966730c109204f7e94ffa2b20ce.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2011-09-08',
'seats_number': 7,
'seller_name': None,
'title': 'Renault Scenic 1.5 dCi Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2011}
2026-04-27 08:05:01 [auto1.it] INFO: Saving data for FU36199: {'created_time': 1777277101.984382, 'last_price_update_time': 1777277101.984395, 'has_photos': True, 'auction_closing_time': 1777390524.0}
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PJ86967> (referer: https://www.auto1.com/v1/car-details-view/PJ86967/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UM88538> (referer: https://www.auto1.com/v1/car-details-view/UM88538/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5510>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e910>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33dbe80f-ed11-5f93-acca-1539e7439de0 with identifier: PJ86967
2026-04-27 08:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dbe80f-ed11-5f93-acca-1539e7439de0 with scrape type 1
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_a11e1dc238989829cd3965214c379635.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad955b2c-6f61-5f3d-9199-5efdf22a22ae with identifier: UM88538
2026-04-27 08:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae with scrape type 1
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_7e6ef264090e84925cde202432024f6b.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_7c367b66ae5c25adb56b528ead94bce6.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_c143ec8e781f6f352f04fb52ba97683e.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_2da91fd0f4f09e568c596ec0b8b43d56.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_91cfdd840913eca3d4eb7ac0c2d34c79.jpg not downloaded yet
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_b594008f45d611f90ca437bcaeaec40e.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e3086c0d2a1cae4b0acedf4bcc377f99.jpg not downloaded yet
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_29110463c1c80efe208d6c1d246441de.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_cb89bd9aee6c2e9392308a8b18d79ec8.jpg not downloaded yet
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c6550>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_0eb5acf610add4e157665ac054239e57.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_2dde08e45713569dd7a0e1d84095a553.jpg not downloaded yet
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a1910>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_6c0f39e5cca790959695636ff97e2247.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_23fd00c3876c8c8498450360941e819c.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_02127e1dbb78de90c05943b3fdc7021b.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e43f04d5847291a8c8cdb32b1cf2b7e8.jpg not downloaded yet
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5787d10>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_c143ec8e781f6f352f04fb52ba97683e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_67e1b18d9cb0841d0a83c69b3e4e9577.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_b415f41ad7e9351d4cf300c239653144.jpg not downloaded yet
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e3086c0d2a1cae4b0acedf4bcc377f99.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_4c3f0f81b77fad5cf168a5226eb43c1e.jpg not downloaded yet
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_383ae54b517497ac28897c11d3a4b3b1.jpg not downloaded yet
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e050>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6487750>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_c143ec8e781f6f352f04fb52ba97683e.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead7285390>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e3086c0d2a1cae4b0acedf4bcc377f99.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_cb89bd9aee6c2e9392308a8b18d79ec8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e43f04d5847291a8c8cdb32b1cf2b7e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839ab50>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_cb89bd9aee6c2e9392308a8b18d79ec8.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_b415f41ad7e9351d4cf300c239653144.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3d890>
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e43f04d5847291a8c8cdb32b1cf2b7e8.jpg saved to cache
2026-04-27 08:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_383ae54b517497ac28897c11d3a4b3b1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547f950>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_b415f41ad7e9351d4cf300c239653144.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_4c3f0f81b77fad5cf168a5226eb43c1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513290>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_383ae54b517497ac28897c11d3a4b3b1.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_67e1b18d9cb0841d0a83c69b3e4e9577.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_02127e1dbb78de90c05943b3fdc7021b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f6710>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_4c3f0f81b77fad5cf168a5226eb43c1e.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63874d0>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_67e1b18d9cb0841d0a83c69b3e4e9577.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5645c50>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_02127e1dbb78de90c05943b3fdc7021b.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_23fd00c3876c8c8498450360941e819c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_2dde08e45713569dd7a0e1d84095a553.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_6c0f39e5cca790959695636ff97e2247.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547cad0>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_23fd00c3876c8c8498450360941e819c.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f5150>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_2dde08e45713569dd7a0e1d84095a553.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d8d0>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_6c0f39e5cca790959695636ff97e2247.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_b594008f45d611f90ca437bcaeaec40e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_29110463c1c80efe208d6c1d246441de.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_0eb5acf610add4e157665ac054239e57.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54df290>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_b594008f45d611f90ca437bcaeaec40e.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50890>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_29110463c1c80efe208d6c1d246441de.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dde90>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_0eb5acf610add4e157665ac054239e57.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_7c367b66ae5c25adb56b528ead94bce6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_2da91fd0f4f09e568c596ec0b8b43d56.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_7e6ef264090e84925cde202432024f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_a11e1dc238989829cd3965214c379635.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_91cfdd840913eca3d4eb7ac0c2d34c79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817910>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_7c367b66ae5c25adb56b528ead94bce6.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a00d50>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_2da91fd0f4f09e568c596ec0b8b43d56.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577a510>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_7e6ef264090e84925cde202432024f6b.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667790>
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_a11e1dc238989829cd3965214c379635.jpg saved to cache
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33dbe80f-ed11-5f93-acca-1539e7439de0
2026-04-27 08:05:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33dbe80f-ed11-5f93-acca-1539e7439de0, skipping ID generation
2026-04-27 08:05:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33dbe80f-ed11-5f93-acca-1539e7439de0 with scrape type 1
2026-04-27 08:05:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33dbe80f-ed11-5f93-acca-1539e7439de0 sending to next pipeline
2026-04-27 08:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 33dbe80f-ed11-5f93-acca-1539e7439de0, identifier: PJ86967
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5969e90>
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_91cfdd840913eca3d4eb7ac0c2d34c79.jpg saved to cache
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae
2026-04-27 08:05:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ad955b2c-6f61-5f3d-9199-5efdf22a22ae, skipping ID generation
2026-04-27 08:05:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae with scrape type 1
2026-04-27 08:05:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ad955b2c-6f61-5f3d-9199-5efdf22a22ae sending to next pipeline
2026-04-27 08:05:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ad955b2c-6f61-5f3d-9199-5efdf22a22ae, identifier: UM88538
2026-04-27 08:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 33dbe80f-ed11-5f93-acca-1539e7439de0 with identifier: PJ86967
2026-04-27 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 33dbe80f-ed11-5f93-acca-1539e7439de0 with identifier: PJ86967
2026-04-27 08:05:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 33dbe80f-ed11-5f93-acca-1539e7439de0 with identifier: PJ86967 to the API
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_a11e1dc238989829cd3965214c379635.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Varedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:15:07Z',
'fuel_type': 'diesel',
'id': '33dbe80f-ed11-5f93-acca-1539e7439de0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ86967',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Land Rover',
'model': 'Evoque',
'odometer': 78548,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71849,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_a11e1dc238989829cd3965214c379635.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_7c367b66ae5c25adb56b528ead94bce6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68015,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_2da91fd0f4f09e568c596ec0b8b43d56.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_b594008f45d611f90ca437bcaeaec40e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61161,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_29110463c1c80efe208d6c1d246441de.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_0eb5acf610add4e157665ac054239e57.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51081,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_6c0f39e5cca790959695636ff97e2247.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_02127e1dbb78de90c05943b3fdc7021b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66332,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_67e1b18d9cb0841d0a83c69b3e4e9577.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_33dbe80f-ed11-5f93-acca-1539e7439de0/33dbe80f-ed11-5f93-acca-1539e7439de0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55486,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3a/01/3a0108e2cc662cc2a43ea82e395c113f/pa/PJ86967_4c3f0f81b77fad5cf168a5226eb43c1e.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-09-19',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Evoque 2.0 Sd4 SE Dynamic',
'transmission': 'automatic',
'trim': 'SE Dynamic',
'year': 2016}
2026-04-27 08:05:04 [auto1.it] INFO: Saving data for PJ86967: {'created_time': 1777277104.856781, 'last_price_update_time': 1777277104.856796, 'has_photos': True, 'auction_closing_time': 1777389307.0}
2026-04-27 08:05:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ad955b2c-6f61-5f3d-9199-5efdf22a22ae with identifier: UM88538
2026-04-27 08:05:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ad955b2c-6f61-5f3d-9199-5efdf22a22ae with identifier: UM88538
2026-04-27 08:05:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ad955b2c-6f61-5f3d-9199-5efdf22a22ae with identifier: UM88538 to the API
2026-04-27 08:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_91cfdd840913eca3d4eb7ac0c2d34c79.jpg>
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Senago',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-04-28T15:27:56Z',
'fuel_type': 'petrol',
'id': 'ad955b2c-6f61-5f3d-9199-5efdf22a22ae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UM88538',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Fiat',
'model': 'Panda',
'odometer': 1137,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83890,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_7e6ef264090e84925cde202432024f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_c143ec8e781f6f352f04fb52ba97683e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74963,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_91cfdd840913eca3d4eb7ac0c2d34c79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e3086c0d2a1cae4b0acedf4bcc377f99.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_cb89bd9aee6c2e9392308a8b18d79ec8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_2dde08e45713569dd7a0e1d84095a553.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_23fd00c3876c8c8498450360941e819c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_e43f04d5847291a8c8cdb32b1cf2b7e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81149,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_b415f41ad7e9351d4cf300c239653144.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ad955b2c-6f61-5f3d-9199-5efdf22a22ae/ad955b2c-6f61-5f3d-9199-5efdf22a22ae_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img37/64/3764c794bea17e969cd0631c2627b3bf/pa/UM88538_383ae54b517497ac28897c11d3a4b3b1.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2026-01-27',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid Pandina Icon',
'transmission': 'manual',
'trim': 'Pandina Icon',
'year': 2026}
2026-04-27 08:05:05 [auto1.it] INFO: Saving data for UM88538: {'created_time': 1777277105.257236, 'last_price_update_time': 1777277105.257249, 'has_photos': True, 'auction_closing_time': 1777390076.0}
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9d29d2bbc579599bb847fa077c465d00.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6476f50>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785610>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9d29d2bbc579599bb847fa077c465d00.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55083d0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555e2d0>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg saved to cache
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f8e7b06-aced-5960-83ac-a7e449c0d435
2026-04-27 08:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f8e7b06-aced-5960-83ac-a7e449c0d435, skipping ID generation
2026-04-27 08:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 with scrape type 1
2026-04-27 08:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f8e7b06-aced-5960-83ac-a7e449c0d435 sending to next pipeline
2026-04-27 08:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7f8e7b06-aced-5960-83ac-a7e449c0d435, identifier: LX14349
2026-04-27 08:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-04-27 08:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349
2026-04-27 08:05:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f8e7b06-aced-5960-83ac-a7e449c0d435 with identifier: LX14349 to the API
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Milazzo',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:51:36Z',
'fuel_type': 'diesel',
'id': '7f8e7b06-aced-5960-83ac-a7e449c0d435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX14349',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Lancia',
'model': 'Ypsilon',
'odometer': 198988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111174,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_eac74d6b9dcd2ddcc62831631ffb82b7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110971,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_41ea504a6ff6cf53a8b637c43eda368f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101565,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_1e5f2985773c222e4d08368fcd11ab38.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69669,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_88f517a5c812e972565011330860c366.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96847,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_3c187713e6728e616791e3b6dfc2fdb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99022,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_c7446054954f668bb012648d681917fa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_edb08aee4935e7ba2ad3c5a00be9b175.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100159,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_37855beeea9a67381281cd7fd7c1af1b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_6dfb5d184d909cebda9d2913ac0dac78.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8e7b06-aced-5960-83ac-a7e449c0d435/7f8e7b06-aced-5960-83ac-a7e449c0d435_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge7/9e/e79ec132c91bffb2baa0c0f277180645/pa/LX14349_93d8bb3ff1ba3f3759a85c0c6823c44b.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2015-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'Lancia Ypsilon 1.3 JTD Gold',
'transmission': 'manual',
'trim': 'Gold',
'year': 2015}
2026-04-27 08:05:05 [auto1.it] INFO: Saving data for LX14349: {'created_time': 1777277105.946484, 'last_price_update_time': 1777277105.946495, 'has_photos': True, 'auction_closing_time': 1777391496.0}
2026-04-27 08:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a01190>
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555a890>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6475810>
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:06 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg saved to cache
2026-04-27 08:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:05:10 [scrapy.extensions.logstats] INFO: Crawled 514 pages (at 28 pages/min), scraped 217 items (at 14 items/min)
2026-04-27 08:05:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PP32682/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YT13161> (referer: https://www.auto1.com/v1/car-details-view/YT13161/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_536cec561ad66fd110b1235611726b4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd210e16-a3e3-5330-bb4b-8f8dfff536ce with identifier: YT13161
2026-04-27 08:05:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce with scrape type 1
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_82a20ae628bd189df6e4db82f5e793ae.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_a982ea0eb77749aa81b6dc3ba71fda70.jpg not downloaded yet
2026-04-27 08:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1abc785cdaa874978ebd52c774bab63b.jpg not downloaded yet
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533a250>
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_536cec561ad66fd110b1235611726b4a.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9
2026-04-27 08:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0654b428-d1ab-55a6-bff7-ae3326d12fb9, skipping ID generation
2026-04-27 08:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with scrape type 1
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0654b428-d1ab-55a6-bff7-ae3326d12fb9 sending to next pipeline
2026-04-27 08:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0654b428-d1ab-55a6-bff7-ae3326d12fb9, identifier: TN35413
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6552704876ee8672316e2a5cc79d2b9e.jpg not downloaded yet
2026-04-27 08:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-04-27 08:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0654b428-d1ab-55a6-bff7-ae3326d12fb9 with identifier: TN35413 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_536cec561ad66fd110b1235611726b4a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 156,
'category': None,
'city': 'Roma',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 218,
'expiration_date': '2026-04-28T15:22:42Z',
'fuel_type': 'diesel',
'id': '0654b428-d1ab-55a6-bff7-ae3326d12fb9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TN35413',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'BMW',
'model': 'X5',
'odometer': 189024,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_883de941e44239dd741e6cd4a8d6f21d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b27c21a6b219483cfd78909fa650d890.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_536cec561ad66fd110b1235611726b4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_a86f2e4e2c87e982ffcee714e0f93fd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65800,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_06771c1046a0edfad7e64ddca65d9ddb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9ee8bf362ff5fcc746f3c3bd10be553d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_9d29d2bbc579599bb847fa077c465d00.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_b25d005d7ae42f2a4983dd6cfb2d616b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69152,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_22fe96d64db0b8c034f27727076f00a6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0654b428-d1ab-55a6-bff7-ae3326d12fb9/0654b428-d1ab-55a6-bff7-ae3326d12fb9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgea/d6/ead65dc30266531fe2f718d531202d30/pa/TN35413_59d4f028b12de7f5a7e3322e497ea168.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2015-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 25d',
'transmission': 'automatic',
'trim': '',
'year': 2015}
2026-04-27 08:05:23 [auto1.it] INFO: Saving data for TN35413: {'created_time': 1777277123.47126, 'last_price_update_time': 1777277123.471288, 'has_photos': True, 'auction_closing_time': 1777389762.0}
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6c0ce82b9cdce240306422fe2167673b.jpg not downloaded yet
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55909d0>
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg saved to cache
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c511151-0d4c-51b0-a9a7-147f7cf03238
2026-04-27 08:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c511151-0d4c-51b0-a9a7-147f7cf03238, skipping ID generation
2026-04-27 08:05:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c511151-0d4c-51b0-a9a7-147f7cf03238 with scrape type 1
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c511151-0d4c-51b0-a9a7-147f7cf03238 sending to next pipeline
2026-04-27 08:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3c511151-0d4c-51b0-a9a7-147f7cf03238, identifier: DC14157
2026-04-27 08:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1467630f8b2b8747f221d5bff4fe4a6f.jpg not downloaded yet
2026-04-27 08:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-04-27 08:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157
2026-04-27 08:05:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3c511151-0d4c-51b0-a9a7-147f7cf03238 with identifier: DC14157 to the API
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg>
{'auction_title': '',
'c_o_2_emission_value': 220,
'category': None,
'city': 'Reggio Emilia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '3.0L',
'engine_horse_power': 250,
'expiration_date': '2026-04-28T15:03:12Z',
'fuel_type': 'diesel',
'id': '3c511151-0d4c-51b0-a9a7-147f7cf03238',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DC14157',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Maserati',
'model': 'Levante',
'odometer': 158390,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_716a7cf2560832629ac95454cf1d4176.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60548,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_96f81c6e97bbf2112b3e39f9a0324ef6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53979,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_3647dc11d74e2cade2ffd1adbabed107.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_b4dd542ee846f3f9ea9c54bec97fc238.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_67a05c4c857998b45eee37b4068de39e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57147,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_4365941974b97f55c2799f8dd3646dae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49881,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_444d0f4d769a0cd5d2e933b3325b3854.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_26c74c8112f46dbcaa3f4dd2c1b8ce60.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_af4a8b39217f5ca85768021cb5cee537.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3c511151-0d4c-51b0-a9a7-147f7cf03238/3c511151-0d4c-51b0-a9a7-147f7cf03238_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img01/06/0106692a74cc0bac53c9d040dae41b35/pa/DC14157_0d1a6e39504bf1686ce254744c6eb359.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'Maserati Levante 3.0 V6 Diesel GranLusso',
'transmission': 'automatic',
'trim': 'GranLusso',
'year': 2019}
2026-04-27 08:05:24 [auto1.it] INFO: Saving data for DC14157: {'created_time': 1777277124.049242, 'last_price_update_time': 1777277124.049255, 'has_photos': True, 'auction_closing_time': 1777388592.0}
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_af0fbacccca4c8370967108e72cd2780.jpg not downloaded yet
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_e7b1089ee591b7599eaaf929ef42dd30.jpg not downloaded yet
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GS36896/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_bd85b85ebcfe46e90f6eb34bb8c2eaf6.jpg not downloaded yet
2026-04-27 08:05:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_19e8b52e2ce77ffa9f726243b4ba9cc5.jpg not downloaded yet
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_e7b1089ee591b7599eaaf929ef42dd30.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56acf10>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_e7b1089ee591b7599eaaf929ef42dd30.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_19e8b52e2ce77ffa9f726243b4ba9cc5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56af810>
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_19e8b52e2ce77ffa9f726243b4ba9cc5.jpg saved to cache
2026-04-27 08:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VC24858> (referer: https://www.auto1.com/v1/car-details-view/VC24858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with identifier: VC24858
2026-04-27 08:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with scrape type 1
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_62cfead791510d84bdf1463ee10624c7.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_be8f1bc89375145592a46ffd6dc03c6f.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_11f7cbb95c18ca8d0826f434da0a0c3f.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_4a666fa2e634d609292a1803c626886e.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_42b928d0803a34cbddf1fd0db6be4e28.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_8183bc9330b742701a6bfc78e994e318.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_2031424441d7d89f2fbd7a31a43e0dcb.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_14d7afb272bef9b035f2625dce1f8a5e.jpg not downloaded yet
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_bd85b85ebcfe46e90f6eb34bb8c2eaf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_dce6e0d8afd4f84ce19596f3fa10fda1.jpg not downloaded yet
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_9fb611d96eefaded5fb2bce71705dc22.jpg not downloaded yet
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e090>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_bd85b85ebcfe46e90f6eb34bb8c2eaf6.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_14d7afb272bef9b035f2625dce1f8a5e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f1e50>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_14d7afb272bef9b035f2625dce1f8a5e.jpg saved to cache
2026-04-27 08:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_9fb611d96eefaded5fb2bce71705dc22.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563e190>
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_9fb611d96eefaded5fb2bce71705dc22.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_dce6e0d8afd4f84ce19596f3fa10fda1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1f910>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_dce6e0d8afd4f84ce19596f3fa10fda1.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_2031424441d7d89f2fbd7a31a43e0dcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5697d50>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_2031424441d7d89f2fbd7a31a43e0dcb.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_8183bc9330b742701a6bfc78e994e318.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839a850>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_8183bc9330b742701a6bfc78e994e318.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_42b928d0803a34cbddf1fd0db6be4e28.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5881d50>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_42b928d0803a34cbddf1fd0db6be4e28.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_4a666fa2e634d609292a1803c626886e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513490>
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_4a666fa2e634d609292a1803c626886e.jpg saved to cache
2026-04-27 08:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_11f7cbb95c18ca8d0826f434da0a0c3f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647a10>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_11f7cbb95c18ca8d0826f434da0a0c3f.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_be8f1bc89375145592a46ffd6dc03c6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_62cfead791510d84bdf1463ee10624c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58147d0>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_be8f1bc89375145592a46ffd6dc03c6f.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5512710>
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_62cfead791510d84bdf1463ee10624c7.jpg saved to cache
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69
2026-04-27 08:05:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69, skipping ID generation
2026-04-27 08:05:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with scrape type 1
2026-04-27 08:05:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 sending to next pipeline
2026-04-27 08:05:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69, identifier: VC24858
2026-04-27 08:05:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with identifier: VC24858
2026-04-27 08:05:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with identifier: VC24858
2026-04-27 08:05:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3ea83d08-582f-56b0-bd2e-5fa3a0a81a69 with identifier: VC24858 to the API
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_62cfead791510d84bdf1463ee10624c7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '0.9L',
'engine_horse_power': 85,
'expiration_date': '2026-04-28T15:31:18Z',
'fuel_type': 'petrol',
'id': '3ea83d08-582f-56b0-bd2e-5fa3a0a81a69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VC24858',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Fiat',
'model': '500',
'odometer': 98473,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_62cfead791510d84bdf1463ee10624c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84091,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_be8f1bc89375145592a46ffd6dc03c6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78958,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_11f7cbb95c18ca8d0826f434da0a0c3f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58876,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_4a666fa2e634d609292a1803c626886e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_42b928d0803a34cbddf1fd0db6be4e28.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75636,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_8183bc9330b742701a6bfc78e994e318.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44420,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_2031424441d7d89f2fbd7a31a43e0dcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76048,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_14d7afb272bef9b035f2625dce1f8a5e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75153,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_dce6e0d8afd4f84ce19596f3fa10fda1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3ea83d08-582f-56b0-bd2e-5fa3a0a81a69/3ea83d08-582f-56b0-bd2e-5fa3a0a81a69_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img79/ed/79ed6cc4b1df9af087eab07924fca151/pa/VC24858_9fb611d96eefaded5fb2bce71705dc22.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2013-06-19',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat 500 0.9 Lounge',
'transmission': 'automatic',
'trim': 'Lounge',
'year': 2013}
2026-04-27 08:05:28 [auto1.it] INFO: Saving data for VC24858: {'created_time': 1777277128.046928, 'last_price_update_time': 1777277128.046942, 'has_photos': True, 'auction_closing_time': 1777390278.0}
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_af0fbacccca4c8370967108e72cd2780.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a53f10>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_af0fbacccca4c8370967108e72cd2780.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1467630f8b2b8747f221d5bff4fe4a6f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6c0ce82b9cdce240306422fe2167673b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839a790>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1467630f8b2b8747f221d5bff4fe4a6f.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6552704876ee8672316e2a5cc79d2b9e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3d10>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6c0ce82b9cdce240306422fe2167673b.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e050>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6552704876ee8672316e2a5cc79d2b9e.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1abc785cdaa874978ebd52c774bab63b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5881690>
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1abc785cdaa874978ebd52c774bab63b.jpg saved to cache
2026-04-27 08:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_a982ea0eb77749aa81b6dc3ba71fda70.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_82a20ae628bd189df6e4db82f5e793ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3610>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_a982ea0eb77749aa81b6dc3ba71fda70.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f1510>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_82a20ae628bd189df6e4db82f5e793ae.jpg saved to cache
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd210e16-a3e3-5330-bb4b-8f8dfff536ce, skipping ID generation
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce with scrape type 1
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd210e16-a3e3-5330-bb4b-8f8dfff536ce sending to next pipeline
2026-04-27 08:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dd210e16-a3e3-5330-bb4b-8f8dfff536ce, identifier: YT13161
2026-04-27 08:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dd210e16-a3e3-5330-bb4b-8f8dfff536ce with identifier: YT13161
2026-04-27 08:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dd210e16-a3e3-5330-bb4b-8f8dfff536ce with identifier: YT13161
2026-04-27 08:05:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dd210e16-a3e3-5330-bb4b-8f8dfff536ce with identifier: YT13161 to the API
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_82a20ae628bd189df6e4db82f5e793ae.jpg>
{'auction_title': '',
'c_o_2_emission_value': 33,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.5L',
'engine_horse_power': 328,
'expiration_date': '2026-04-28T15:40:53Z',
'fuel_type': 'hybrid',
'id': 'dd210e16-a3e3-5330-bb4b-8f8dfff536ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT13161',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Mazda',
'model': 'CX-60',
'odometer': 124490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 117059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_82a20ae628bd189df6e4db82f5e793ae.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_a982ea0eb77749aa81b6dc3ba71fda70.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92747,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1abc785cdaa874978ebd52c774bab63b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6552704876ee8672316e2a5cc79d2b9e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105504,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_6c0ce82b9cdce240306422fe2167673b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_1467630f8b2b8747f221d5bff4fe4a6f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_af0fbacccca4c8370967108e72cd2780.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_e7b1089ee591b7599eaaf929ef42dd30.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100668,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_bd85b85ebcfe46e90f6eb34bb8c2eaf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dd210e16-a3e3-5330-bb4b-8f8dfff536ce/dd210e16-a3e3-5330-bb4b-8f8dfff536ce_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94331,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgbe/36/be36a28f1829e79ea22cb59a6f006184/pa/YT13161_19e8b52e2ce77ffa9f726243b4ba9cc5.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2023-02-08',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-60 2.5 e-Skyactiv Plug-in Hybrid Homura AWD',
'transmission': 'automatic',
'trim': 'Homura AWD',
'year': 2023}
2026-04-27 08:05:29 [auto1.it] INFO: Saving data for YT13161: {'created_time': 1777277129.646396, 'last_price_update_time': 1777277129.646409, 'has_photos': True, 'auction_closing_time': 1777390853.0}
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YN82579> (referer: https://www.auto1.com/v1/car-details-view/YN82579/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6811fe9-50fd-5a79-ada2-64308cbfb859 with identifier: YN82579
2026-04-27 08:05:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6811fe9-50fd-5a79-ada2-64308cbfb859 with scrape type 1
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_cfb13d20532ddb264237d59cc89e6bcb.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_22d81b8d0d2b7f7e694092932221ca6c.jpg not downloaded yet
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_95a8deeef9b27352e1444dd7e09cd5b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_caa92f9d84e55bebd1d5bfca8b3df5c6.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_c006555f206bd720e19052bb4b76b0e2.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_172f5326284daed330991c325a3eed4b.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_b2b0ece38a8265e82a6079630a14c878.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_01dd013a6e5a64ca3aecaa54f9a88cb7.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_227dfb1263ed6edb1437323af475f76a.jpg not downloaded yet
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_3af171ffa4aa166837b84d6025e217c3.jpg not downloaded yet
2026-04-27 08:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_22d81b8d0d2b7f7e694092932221ca6c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_681379eeaa9421d2e8561068033afd82.jpg not downloaded yet
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f3990>
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_95a8deeef9b27352e1444dd7e09cd5b6.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b490>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_22d81b8d0d2b7f7e694092932221ca6c.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_3af171ffa4aa166837b84d6025e217c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c950>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_3af171ffa4aa166837b84d6025e217c3.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_681379eeaa9421d2e8561068033afd82.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_227dfb1263ed6edb1437323af475f76a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0f90>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_681379eeaa9421d2e8561068033afd82.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0110>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_227dfb1263ed6edb1437323af475f76a.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_01dd013a6e5a64ca3aecaa54f9a88cb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b21d0>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_01dd013a6e5a64ca3aecaa54f9a88cb7.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_b2b0ece38a8265e82a6079630a14c878.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576b490>
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_b2b0ece38a8265e82a6079630a14c878.jpg saved to cache
2026-04-27 08:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_172f5326284daed330991c325a3eed4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ca50>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_172f5326284daed330991c325a3eed4b.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_c006555f206bd720e19052bb4b76b0e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576ab90>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_c006555f206bd720e19052bb4b76b0e2.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_caa92f9d84e55bebd1d5bfca8b3df5c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_cfb13d20532ddb264237d59cc89e6bcb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547c510>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_caa92f9d84e55bebd1d5bfca8b3df5c6.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_249ecd67907f6e977fad4112984a3683.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55932d0>
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_cfb13d20532ddb264237d59cc89e6bcb.jpg saved to cache
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6811fe9-50fd-5a79-ada2-64308cbfb859
2026-04-27 08:05:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6811fe9-50fd-5a79-ada2-64308cbfb859, skipping ID generation
2026-04-27 08:05:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6811fe9-50fd-5a79-ada2-64308cbfb859 with scrape type 1
2026-04-27 08:05:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6811fe9-50fd-5a79-ada2-64308cbfb859 sending to next pipeline
2026-04-27 08:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6811fe9-50fd-5a79-ada2-64308cbfb859, identifier: YN82579
2026-04-27 08:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6811fe9-50fd-5a79-ada2-64308cbfb859 with identifier: YN82579
2026-04-27 08:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6811fe9-50fd-5a79-ada2-64308cbfb859 with identifier: YN82579
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6811fe9-50fd-5a79-ada2-64308cbfb859 with identifier: YN82579 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_cfb13d20532ddb264237d59cc89e6bcb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'category': None,
'city': 'Varedo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:11:41Z',
'fuel_type': 'petrol',
'id': 'e6811fe9-50fd-5a79-ada2-64308cbfb859',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN82579',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Peugeot',
'model': '107',
'odometer': 36747,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_cfb13d20532ddb264237d59cc89e6bcb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_22d81b8d0d2b7f7e694092932221ca6c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71451,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_caa92f9d84e55bebd1d5bfca8b3df5c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61860,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_c006555f206bd720e19052bb4b76b0e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_172f5326284daed330991c325a3eed4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75454,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_b2b0ece38a8265e82a6079630a14c878.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_01dd013a6e5a64ca3aecaa54f9a88cb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74480,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_227dfb1263ed6edb1437323af475f76a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_3af171ffa4aa166837b84d6025e217c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6811fe9-50fd-5a79-ada2-64308cbfb859/e6811fe9-50fd-5a79-ada2-64308cbfb859_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img89/85/89852377d8884f99eb333a56cf30e478/pa/YN82579_681379eeaa9421d2e8561068033afd82.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2009-09-02',
'seats_number': 4,
'seller_name': None,
'title': 'Peugeot 107 1.0 Plasir',
'transmission': 'automatic',
'trim': 'Plasir',
'year': 2009}
2026-04-27 08:05:32 [auto1.it] INFO: Saving data for YN82579: {'created_time': 1777277132.370326, 'last_price_update_time': 1777277132.370335, 'has_photos': True, 'auction_closing_time': 1777389101.0}
2026-04-27 08:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b0cf4c834f1e041b4f970d27579becde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d3fd0>
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_249ecd67907f6e977fad4112984a3683.jpg saved to cache
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5591810>
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b0cf4c834f1e041b4f970d27579becde.jpg saved to cache
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef0340cd-e315-5a63-b3d1-873afd94866f
2026-04-27 08:05:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef0340cd-e315-5a63-b3d1-873afd94866f, skipping ID generation
2026-04-27 08:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef0340cd-e315-5a63-b3d1-873afd94866f with scrape type 1
2026-04-27 08:05:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef0340cd-e315-5a63-b3d1-873afd94866f sending to next pipeline
2026-04-27 08:05:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ef0340cd-e315-5a63-b3d1-873afd94866f, identifier: MM75159
2026-04-27 08:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ef0340cd-e315-5a63-b3d1-873afd94866f with identifier: MM75159
2026-04-27 08:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ef0340cd-e315-5a63-b3d1-873afd94866f with identifier: MM75159
2026-04-27 08:05:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ef0340cd-e315-5a63-b3d1-873afd94866f with identifier: MM75159 to the API
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b0cf4c834f1e041b4f970d27579becde.jpg>
{'auction_title': '',
'c_o_2_emission_value': 266,
'category': None,
'city': 'Milano',
'color': 'white',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6',
'engine': '2.3L',
'engine_horse_power': 155,
'expiration_date': '2026-04-28T15:43:02Z',
'fuel_type': 'diesel',
'id': 'ef0340cd-e315-5a63-b3d1-873afd94866f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MM75159',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Iveco',
'model': 'Daily',
'odometer': 318866,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b0cf4c834f1e041b4f970d27579becde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_249ecd67907f6e977fad4112984a3683.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_95a8deeef9b27352e1444dd7e09cd5b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46658,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_9aeb524e6fbfe7396198a414870eedec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_368cdda197eae807c9de6da9f0aa3bc5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44101,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_b6391c57a3197e12c0b8a05fea7b4f80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59341,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_740e72e4b8ab1af3c045e9f10de7cea0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44224,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_1f07ce2d287103db7e69479b969d7db9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_59f43106f5a03587959a48f45cffb054.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ef0340cd-e315-5a63-b3d1-873afd94866f/ef0340cd-e315-5a63-b3d1-873afd94866f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img08/84/0884fc8160e0a8b6db17d55228cc8fe4/pa/MM75159_0ee824ab0dc02ed19cd95848752f45cb.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2022-03-07',
'seats_number': 3,
'seller_name': None,
'title': 'Iveco Daily 2.3 Diesel HKa 35 S V Radstand 4100',
'transmission': 'manual',
'trim': 'HKa 35 S V Radstand 4100',
'year': 2022}
2026-04-27 08:05:32 [auto1.it] INFO: Saving data for MM75159: {'created_time': 1777277132.985259, 'last_price_update_time': 1777277132.98527, 'has_photos': True, 'auction_closing_time': 1777390982.0}
2026-04-27 08:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DT30257/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KZ67108/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SE74727/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GX58945> (referer: https://www.auto1.com/v1/car-details-view/GX58945/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32315701-222d-5255-909d-db7ca3fb7968 with identifier: GX58945
2026-04-27 08:05:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32315701-222d-5255-909d-db7ca3fb7968 with scrape type 1
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_1913b903ded8bfd5f01e3583988de099.jpg not downloaded yet
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_5c8a42e18153125dc2d8af70fa9f012e.jpg not downloaded yet
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_e42f8b051c0ab9f4a6c2321ebeed171d.jpg not downloaded yet
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_6bb21f519c42ec559c65039860068197.jpg not downloaded yet
2026-04-27 08:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_b31b1d859f089701ae345ad6b12b0e8c.jpg not downloaded yet
2026-04-27 08:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NK66633/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_b31b1d859f089701ae345ad6b12b0e8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b2950>
2026-04-27 08:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_b31b1d859f089701ae345ad6b12b0e8c.jpg saved to cache
2026-04-27 08:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.784(s), this was the 1st time calling it.
2026-04-27 08:05:45 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.418770527533496 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PP32682> (referer: https://www.auto1.com/v1/car-details-view/PP32682/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YJ48407> (referer: https://www.auto1.com/v1/car-details-view/YJ48407/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with identifier: PP32682
2026-04-27 08:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with scrape type 1
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_e696bc70620de5cfd3ea0ebe7e02893e.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f850655c3a101af41c398ab567ffda2f.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220cec8d2f068a2025e2bc8f996f0348.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_37454be6389a2307040c1bea7ed8e1f5.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034db0ff-5609-52ea-9948-d5b942f4f0aa with identifier: YJ48407
2026-04-27 08:05:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034db0ff-5609-52ea-9948-d5b942f4f0aa with scrape type 1
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_c1d41e75f0e83807215751f52fdfaaf6.jpg not downloaded yet
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_e42f8b051c0ab9f4a6c2321ebeed171d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_6bb21f519c42ec559c65039860068197.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_913db846742a62dc163044ed42a19f10.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_7acba2c38bca55eb9c186449c14f9737.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_22043875947b66a6f0ef8a9495cfa04b.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d4aeb410f95f3d8021183f67b475c0f4.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_44984a1bfa76c26d41bf92e6ac44f5dd.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_846f95e6f8a797047b4fc9c885aa5127.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220fc3344f48a5b1d234b8a76c17fd7e.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d022b1f1f1935b48f0149632c724fa66.jpg not downloaded yet
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_c1d41e75f0e83807215751f52fdfaaf6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f915666a23d59b9765e8c1b34f8ae82b.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f8824b68232cc14c9d6b46b94a14eee5.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f3735e4bdb1f35645cb23ba72d72a800.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_e06dfb3805e5ce1ab951c99443170cef.jpg not downloaded yet
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784a10>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_e42f8b051c0ab9f4a6c2321ebeed171d.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5926590>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_6bb21f519c42ec559c65039860068197.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_37454be6389a2307040c1bea7ed8e1f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f3f3b070e7f13857d41ee92977ffbd51.jpg not downloaded yet
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_eebcd2a471567f09d71a9ff29337fd11.jpg not downloaded yet
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551da10>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_c1d41e75f0e83807215751f52fdfaaf6.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_a96513408f5ae7d0b65b99ee0fbc641b.jpg not downloaded yet
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220fc3344f48a5b1d234b8a76c17fd7e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552fb50>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_37454be6389a2307040c1bea7ed8e1f5.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_e06dfb3805e5ce1ab951c99443170cef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817790>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220fc3344f48a5b1d234b8a76c17fd7e.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7d90>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_e06dfb3805e5ce1ab951c99443170cef.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_a96513408f5ae7d0b65b99ee0fbc641b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_eebcd2a471567f09d71a9ff29337fd11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483b10>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_a96513408f5ae7d0b65b99ee0fbc641b.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721fc90>
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_eebcd2a471567f09d71a9ff29337fd11.jpg saved to cache
2026-04-27 08:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f3f3b070e7f13857d41ee92977ffbd51.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f3735e4bdb1f35645cb23ba72d72a800.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW41660/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f915666a23d59b9765e8c1b34f8ae82b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56645d0>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f3f3b070e7f13857d41ee92977ffbd51.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6d50>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f3735e4bdb1f35645cb23ba72d72a800.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d022b1f1f1935b48f0149632c724fa66.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e590>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f915666a23d59b9765e8c1b34f8ae82b.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_846f95e6f8a797047b4fc9c885aa5127.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f8824b68232cc14c9d6b46b94a14eee5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_44984a1bfa76c26d41bf92e6ac44f5dd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_22043875947b66a6f0ef8a9495cfa04b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d4aeb410f95f3d8021183f67b475c0f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552f1d0>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d022b1f1f1935b48f0149632c724fa66.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664690>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_846f95e6f8a797047b4fc9c885aa5127.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba5d0>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f8824b68232cc14c9d6b46b94a14eee5.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a2310>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_44984a1bfa76c26d41bf92e6ac44f5dd.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_913db846742a62dc163044ed42a19f10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6384350>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_22043875947b66a6f0ef8a9495cfa04b.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f5ad0>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d4aeb410f95f3d8021183f67b475c0f4.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_7acba2c38bca55eb9c186449c14f9737.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555e750>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_913db846742a62dc163044ed42a19f10.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220cec8d2f068a2025e2bc8f996f0348.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f850655c3a101af41c398ab567ffda2f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0710>
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_7acba2c38bca55eb9c186449c14f9737.jpg saved to cache
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 034db0ff-5609-52ea-9948-d5b942f4f0aa
2026-04-27 08:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 034db0ff-5609-52ea-9948-d5b942f4f0aa, skipping ID generation
2026-04-27 08:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034db0ff-5609-52ea-9948-d5b942f4f0aa with scrape type 1
2026-04-27 08:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 034db0ff-5609-52ea-9948-d5b942f4f0aa sending to next pipeline
2026-04-27 08:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 034db0ff-5609-52ea-9948-d5b942f4f0aa, identifier: YJ48407
2026-04-27 08:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 034db0ff-5609-52ea-9948-d5b942f4f0aa with identifier: YJ48407
2026-04-27 08:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 034db0ff-5609-52ea-9948-d5b942f4f0aa with identifier: YJ48407
2026-04-27 08:05:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 034db0ff-5609-52ea-9948-d5b942f4f0aa with identifier: YJ48407 to the API
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_7acba2c38bca55eb9c186449c14f9737.jpg>
{'auction_title': '',
'c_o_2_emission_value': 150,
'category': None,
'city': 'Manoppello',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 135,
'expiration_date': '2026-04-28T15:11:46Z',
'fuel_type': 'diesel',
'id': '034db0ff-5609-52ea-9948-d5b942f4f0aa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 42.2592,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YJ48407',
'listing': 'auction',
'location': 'IT, Manoppello (PE)',
'location_confidence': 'geocoded',
'longitude': 14.0602,
'make': 'Mercedes-Benz',
'model': 'GLA-Klasse',
'odometer': 106982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63040,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_c1d41e75f0e83807215751f52fdfaaf6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58478,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_7acba2c38bca55eb9c186449c14f9737.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d4aeb410f95f3d8021183f67b475c0f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46662,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_846f95e6f8a797047b4fc9c885aa5127.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_d022b1f1f1935b48f0149632c724fa66.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52029,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f8824b68232cc14c9d6b46b94a14eee5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_e06dfb3805e5ce1ab951c99443170cef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_f3f3b070e7f13857d41ee92977ffbd51.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_eebcd2a471567f09d71a9ff29337fd11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_034db0ff-5609-52ea-9948-d5b942f4f0aa/034db0ff-5609-52ea-9948-d5b942f4f0aa_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img90/a3/90a3ac6b04d7822adefd08247ce1e057/pa/YJ48407_a96513408f5ae7d0b65b99ee0fbc641b.jpg',
'Width': 800}],
'postal_code': '65024',
'price': 0,
'price_includes_vat': True,
'province': 'Pescara',
'province_code': 'IT-PE',
'region': 'Abruzzi',
'region_code': 'IT-01',
'registration_date': '2020-01-01',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLA-Klasse GLA 200 d Premium',
'transmission': 'automatic',
'trim': 'Premium',
'year': 2020}
2026-04-27 08:05:52 [auto1.it] INFO: Saving data for YJ48407: {'created_time': 1777277152.454263, 'last_price_update_time': 1777277152.454272, 'has_photos': True, 'auction_closing_time': 1777389106.0}
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_5c8a42e18153125dc2d8af70fa9f012e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_e696bc70620de5cfd3ea0ebe7e02893e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC90942/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564e890>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220cec8d2f068a2025e2bc8f996f0348.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead721ff90>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f850655c3a101af41c398ab567ffda2f.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_1913b903ded8bfd5f01e3583988de099.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784b50>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_5c8a42e18153125dc2d8af70fa9f012e.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83989d0>
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_e696bc70620de5cfd3ea0ebe7e02893e.jpg saved to cache
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951
2026-04-27 08:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1111b7bd-cda4-51bd-be74-fc27cbf8b951, skipping ID generation
2026-04-27 08:05:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with scrape type 1
2026-04-27 08:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1111b7bd-cda4-51bd-be74-fc27cbf8b951 sending to next pipeline
2026-04-27 08:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1111b7bd-cda4-51bd-be74-fc27cbf8b951, identifier: PP32682
2026-04-27 08:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with identifier: PP32682
2026-04-27 08:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with identifier: PP32682
2026-04-27 08:05:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1111b7bd-cda4-51bd-be74-fc27cbf8b951 with identifier: PP32682 to the API
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_e696bc70620de5cfd3ea0ebe7e02893e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:14:18Z',
'fuel_type': 'petrol',
'id': '1111b7bd-cda4-51bd-be74-fc27cbf8b951',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PP32682',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'DR',
'model': 'Zero',
'odometer': 44727,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83170,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_e696bc70620de5cfd3ea0ebe7e02893e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69464,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f850655c3a101af41c398ab567ffda2f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80833,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220cec8d2f068a2025e2bc8f996f0348.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62318,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_37454be6389a2307040c1bea7ed8e1f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_913db846742a62dc163044ed42a19f10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53182,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_22043875947b66a6f0ef8a9495cfa04b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57270,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_44984a1bfa76c26d41bf92e6ac44f5dd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_220fc3344f48a5b1d234b8a76c17fd7e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79630,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f915666a23d59b9765e8c1b34f8ae82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1111b7bd-cda4-51bd-be74-fc27cbf8b951/1111b7bd-cda4-51bd-be74-fc27cbf8b951_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img40/61/40610170921071ab6e9b0799d28f69cc/pa/PP32682_f3735e4bdb1f35645cb23ba72d72a800.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2019-08-28',
'seats_number': 4,
'seller_name': None,
'title': 'DR Zero 1.0',
'transmission': 'manual',
'trim': '',
'year': 2019}
2026-04-27 08:05:53 [auto1.it] INFO: Saving data for PP32682: {'created_time': 1777277153.05552, 'last_price_update_time': 1777277153.05553, 'has_photos': True, 'auction_closing_time': 1777389258.0}
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ad390>
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_1913b903ded8bfd5f01e3583988de099.jpg saved to cache
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 32315701-222d-5255-909d-db7ca3fb7968
2026-04-27 08:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 32315701-222d-5255-909d-db7ca3fb7968, skipping ID generation
2026-04-27 08:05:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32315701-222d-5255-909d-db7ca3fb7968 with scrape type 1
2026-04-27 08:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 32315701-222d-5255-909d-db7ca3fb7968 sending to next pipeline
2026-04-27 08:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 32315701-222d-5255-909d-db7ca3fb7968, identifier: GX58945
2026-04-27 08:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 32315701-222d-5255-909d-db7ca3fb7968 with identifier: GX58945
2026-04-27 08:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 32315701-222d-5255-909d-db7ca3fb7968 with identifier: GX58945
2026-04-27 08:05:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 32315701-222d-5255-909d-db7ca3fb7968 with identifier: GX58945 to the API
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_1913b903ded8bfd5f01e3583988de099.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Padova',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 65,
'expiration_date': '2026-04-28T15:16:13Z',
'fuel_type': 'petrol',
'id': '32315701-222d-5255-909d-db7ca3fb7968',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GX58945',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Toyota',
'model': 'Yaris',
'odometer': 196257,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66348,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_1913b903ded8bfd5f01e3583988de099.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62693,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_5c8a42e18153125dc2d8af70fa9f012e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64815,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_e42f8b051c0ab9f4a6c2321ebeed171d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_6bb21f519c42ec559c65039860068197.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_32315701-222d-5255-909d-db7ca3fb7968/32315701-222d-5255-909d-db7ca3fb7968_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd7/1d/d71db797660700a34ecda69e6cf888f5/pa/GX58945_b31b1d859f089701ae345ad6b12b0e8c.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2003-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Yaris 1.0 VVT-i',
'transmission': 'manual',
'trim': '',
'year': 2003}
2026-04-27 08:05:53 [auto1.it] INFO: Saving data for GX58945: {'created_time': 1777277153.550285, 'last_price_update_time': 1777277153.550373, 'has_photos': True, 'auction_closing_time': 1777389373.0}
2026-04-27 08:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EZ15465/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DT30257> (referer: https://www.auto1.com/v1/car-details-view/DT30257/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with identifier: DT30257
2026-04-27 08:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with scrape type 1
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_b04ce0cde844b8539233cffd6c14c653.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_01b41be999bf9a398520218254a74626.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_cc3eea9fbaeb51a40ccb2cee67ba923d.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_190480d6026ad8963e7c9158bb132bad.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_ed14d55d7a7818b79f7a174448451db5.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_223cb2c3bfc8cb0b286f5849d5beeb0f.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_8ea1e0df4554b6e23b6b3698d78a0b13.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_c6dc5ca49fc5dc22d0ff868d25ea4790.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_3f307c1ea0af3a53b17d08e842676dbf.jpg not downloaded yet
2026-04-27 08:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_e67b9f6cbba77f4e773b69dce1bdfea6.jpg not downloaded yet
2026-04-27 08:05:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KZ67108> (referer: https://www.auto1.com/v1/car-details-view/KZ67108/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6521027-98a8-5112-9789-49ee19956418 with identifier: KZ67108
2026-04-27 08:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6521027-98a8-5112-9789-49ee19956418 with scrape type 1
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_dbdee9956b45ec9f7b6017ec83ab5c97.jpg not downloaded yet
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_24dccadfe81992f706e9f83ceb9272e8.jpg not downloaded yet
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_f5bedff565e214f8fec218bb7ff232b3.jpg not downloaded yet
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_fd08f578ba2287c773dbe188741b254d.jpg not downloaded yet
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_16351c6c9bf43c0308c44c73b88b1535.jpg not downloaded yet
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_e67b9f6cbba77f4e773b69dce1bdfea6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_16351c6c9bf43c0308c44c73b88b1535.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5779ad0>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_e67b9f6cbba77f4e773b69dce1bdfea6.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_fd08f578ba2287c773dbe188741b254d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c6410>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_16351c6c9bf43c0308c44c73b88b1535.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_f5bedff565e214f8fec218bb7ff232b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54df010>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_fd08f578ba2287c773dbe188741b254d.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2ab90>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_f5bedff565e214f8fec218bb7ff232b3.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_24dccadfe81992f706e9f83ceb9272e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_dbdee9956b45ec9f7b6017ec83ab5c97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5880810>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_24dccadfe81992f706e9f83ceb9272e8.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596ac50>
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_dbdee9956b45ec9f7b6017ec83ab5c97.jpg saved to cache
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6521027-98a8-5112-9789-49ee19956418
2026-04-27 08:05:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6521027-98a8-5112-9789-49ee19956418, skipping ID generation
2026-04-27 08:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6521027-98a8-5112-9789-49ee19956418 with scrape type 1
2026-04-27 08:05:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6521027-98a8-5112-9789-49ee19956418 sending to next pipeline
2026-04-27 08:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e6521027-98a8-5112-9789-49ee19956418, identifier: KZ67108
2026-04-27 08:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e6521027-98a8-5112-9789-49ee19956418 with identifier: KZ67108
2026-04-27 08:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e6521027-98a8-5112-9789-49ee19956418 with identifier: KZ67108
2026-04-27 08:05:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e6521027-98a8-5112-9789-49ee19956418 with identifier: KZ67108 to the API
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_dbdee9956b45ec9f7b6017ec83ab5c97.jpg>
{'auction_title': '',
'c_o_2_emission_value': 130,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.3L',
'engine_horse_power': 83,
'expiration_date': '2026-04-28T15:08:04Z',
'fuel_type': 'petrol',
'id': 'e6521027-98a8-5112-9789-49ee19956418',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ67108',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'DR',
'model': '2',
'odometer': 109859,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89221,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_dbdee9956b45ec9f7b6017ec83ab5c97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93099,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_24dccadfe81992f706e9f83ceb9272e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_f5bedff565e214f8fec218bb7ff232b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56113,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_fd08f578ba2287c773dbe188741b254d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e6521027-98a8-5112-9789-49ee19956418/e6521027-98a8-5112-9789-49ee19956418_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47252,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img7d/ed/7dedeb7e22a41a26a6c74385bbc032b0/pa/KZ67108_16351c6c9bf43c0308c44c73b88b1535.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2011-06-04',
'seats_number': 5,
'seller_name': None,
'title': 'DR 2 1.3',
'transmission': 'manual',
'trim': '',
'year': 2011}
2026-04-27 08:05:57 [auto1.it] INFO: Saving data for KZ67108: {'created_time': 1777277157.32997, 'last_price_update_time': 1777277157.329984, 'has_photos': True, 'auction_closing_time': 1777388884.0}
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_3f307c1ea0af3a53b17d08e842676dbf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5882510>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_3f307c1ea0af3a53b17d08e842676dbf.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES07755/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_c6dc5ca49fc5dc22d0ff868d25ea4790.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GS36896> (referer: https://www.auto1.com/v1/car-details-view/GS36896/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ebd0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_c6dc5ca49fc5dc22d0ff868d25ea4790.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 498ba8ce-1dc3-50dc-b916-24a19a934ebf with identifier: GS36896
2026-04-27 08:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf with scrape type 1
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_00f7c7cd8f10301d8b0a5382f67272d7.jpg not downloaded yet
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_8ea1e0df4554b6e23b6b3698d78a0b13.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_bddac0c72798fd26c655aa82e18b70fb.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_b64c13af1b09180ab82ab246e38333af.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_342c89264b319fb2b47872b139c7bc75.jpg not downloaded yet
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_1cc9acea7102b0652a5f2270980acdba.jpg not downloaded yet
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_ed14d55d7a7818b79f7a174448451db5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_223cb2c3bfc8cb0b286f5849d5beeb0f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564f310>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_8ea1e0df4554b6e23b6b3698d78a0b13.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_342c89264b319fb2b47872b139c7bc75.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_1cc9acea7102b0652a5f2270980acdba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_00f7c7cd8f10301d8b0a5382f67272d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59609d0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_ed14d55d7a7818b79f7a174448451db5.jpg saved to cache
2026-04-27 08:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83afad0>
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_223cb2c3bfc8cb0b286f5849d5beeb0f.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839ab90>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_342c89264b319fb2b47872b139c7bc75.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5482690>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_1cc9acea7102b0652a5f2270980acdba.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56676d0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_00f7c7cd8f10301d8b0a5382f67272d7.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_bddac0c72798fd26c655aa82e18b70fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_b64c13af1b09180ab82ab246e38333af.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5695fd0>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_bddac0c72798fd26c655aa82e18b70fb.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3690>
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_b64c13af1b09180ab82ab246e38333af.jpg saved to cache
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf
2026-04-27 08:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 498ba8ce-1dc3-50dc-b916-24a19a934ebf, skipping ID generation
2026-04-27 08:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf with scrape type 1
2026-04-27 08:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 498ba8ce-1dc3-50dc-b916-24a19a934ebf sending to next pipeline
2026-04-27 08:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 498ba8ce-1dc3-50dc-b916-24a19a934ebf, identifier: GS36896
2026-04-27 08:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 498ba8ce-1dc3-50dc-b916-24a19a934ebf with identifier: GS36896
2026-04-27 08:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 498ba8ce-1dc3-50dc-b916-24a19a934ebf with identifier: GS36896
2026-04-27 08:05:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 498ba8ce-1dc3-50dc-b916-24a19a934ebf with identifier: GS36896 to the API
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:05:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_b64c13af1b09180ab82ab246e38333af.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 65,
'expiration_date': '2026-04-28T15:12:29Z',
'fuel_type': 'petrol',
'id': '498ba8ce-1dc3-50dc-b916-24a19a934ebf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS36896',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Fiat',
'model': 'Punto Evo',
'odometer': 189433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121760,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_00f7c7cd8f10301d8b0a5382f67272d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 118828,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_bddac0c72798fd26c655aa82e18b70fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88179,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_b64c13af1b09180ab82ab246e38333af.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_342c89264b319fb2b47872b139c7bc75.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_498ba8ce-1dc3-50dc-b916-24a19a934ebf/498ba8ce-1dc3-50dc-b916-24a19a934ebf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48433,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc2/2d/c22d53000c27a92e2e2ff23f5934d927/pa/GS36896_1cc9acea7102b0652a5f2270980acdba.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2010-02-28',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto Evo 1.2 Dynamic',
'transmission': 'manual',
'trim': 'Dynamic',
'year': 2010}
2026-04-27 08:05:59 [auto1.it] INFO: Saving data for GS36896: {'created_time': 1777277159.008832, 'last_price_update_time': 1777277159.008842, 'has_photos': True, 'auction_closing_time': 1777389149.0}
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_cc3eea9fbaeb51a40ccb2cee67ba923d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_190480d6026ad8963e7c9158bb132bad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SE74727> (referer: https://www.auto1.com/v1/car-details-view/SE74727/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW41660> (referer: https://www.auto1.com/v1/car-details-view/NW41660/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:05:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_b04ce0cde844b8539233cffd6c14c653.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b36d0>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_cc3eea9fbaeb51a40ccb2cee67ba923d.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feaf2767c10>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_190480d6026ad8963e7c9158bb132bad.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_f3a1ee907fefe7bfa69914ebe9b6f056.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6791cdf3-59fd-515b-97e6-02512e00d8c8 with identifier: NW41660
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6791cdf3-59fd-515b-97e6-02512e00d8c8 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_800a9613cba9ab3beb67d196702476b2.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Channel: 24h | Page: 10 | totalHits: 3141 | hits on page: 40
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_b5ba380f0f3db7ecf03311ecc652d644.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_250a5fdec62e9116a70b70e8355bb952.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: DT30257
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_e2673be9621857c91b0c781672a51074.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_190db6c23d17491c8c6486dd64c9f69e.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: YJ48407
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for YJ48407: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: VC24858
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for VC24858: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: YN82579
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for YN82579: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: UM88538
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for UM88538: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: GX58945
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for GX58945: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: LX14349
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for LX14349: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: JH44016
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760450>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_b04ce0cde844b8539233cffd6c14c653.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_69f30d44330268367e5fea00362e315f.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_849043b33ddc1de1c669b2f0008fa61f.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: VL69252
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for VL69252: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: KZ49625
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for KZ49625: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: FU36199
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for FU36199: 0
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: NY06096
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for NY06096: 1
2026-04-27 08:05:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_01b41be999bf9a398520218254a74626.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_a8148af7645d26e978210f728e368065.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_cd10cb55b20843ac30d8bc1e6539f304.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: FK09468
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for FK09468: 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_02c3ed094493ac893c73251b6f216e17.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_966386dda86b4fe77730bc8a55baf930.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: UF04197
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for UF04197: 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_000e661b1085da1f67f49ea63c040181.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_acd4890f4a3907255a40a3277a535826.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: TA36593
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for TA36593: 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_c4f77af3b316c4784b3692dba4f3675a.jpg not downloaded yet
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_07976ccffe9821bb5c7739ca4e38d912.jpg not downloaded yet
2026-04-27 08:05:59 [auto1.it] INFO: Found listing with ID: GZ99467
2026-04-27 08:05:59 [auto1.it] INFO: Scrape type for GZ99467: 1
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b9610>
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:05:59 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_01b41be999bf9a398520218254a74626.jpg saved to cache
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0
2026-04-27 08:05:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6be1a20e-d1dd-5655-abde-21b7b6d16be0, skipping ID generation
2026-04-27 08:05:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with scrape type 1
2026-04-27 08:05:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6be1a20e-d1dd-5655-abde-21b7b6d16be0 sending to next pipeline
2026-04-27 08:05:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6be1a20e-d1dd-5655-abde-21b7b6d16be0, identifier: DT30257
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_4fdbe9bf16a572c00470b10f97905390.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_dececbd385535126211ef1012bcca82f.jpg not downloaded yet
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: NW55395
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for NW55395: 1
2026-04-27 08:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with identifier: DT30257
2026-04-27 08:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with identifier: DT30257
2026-04-27 08:06:00 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6be1a20e-d1dd-5655-abde-21b7b6d16be0 with identifier: DT30257 to the API
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_01b41be999bf9a398520218254a74626.jpg>
{'auction_title': '',
'c_o_2_emission_value': 160,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:08:31Z',
'fuel_type': 'diesel',
'id': '6be1a20e-d1dd-5655-abde-21b7b6d16be0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DT30257',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 157524,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_b04ce0cde844b8539233cffd6c14c653.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109999,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_01b41be999bf9a398520218254a74626.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_cc3eea9fbaeb51a40ccb2cee67ba923d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77786,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_190480d6026ad8963e7c9158bb132bad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_ed14d55d7a7818b79f7a174448451db5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89764,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_223cb2c3bfc8cb0b286f5849d5beeb0f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68759,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_8ea1e0df4554b6e23b6b3698d78a0b13.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100025,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_c6dc5ca49fc5dc22d0ff868d25ea4790.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102471,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_3f307c1ea0af3a53b17d08e842676dbf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6be1a20e-d1dd-5655-abde-21b7b6d16be0/6be1a20e-d1dd-5655-abde-21b7b6d16be0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf4/ac/f4ac7e5c0a8e67b3b24617e1dbf29d66/pa/DT30257_e67b9f6cbba77f4e773b69dce1bdfea6.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-03-07',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Business Q4',
'transmission': 'automatic',
'trim': 'Business Q4',
'year': 2019}
2026-04-27 08:06:00 [auto1.it] INFO: Saving data for DT30257: {'created_time': 1777277160.392667, 'last_price_update_time': 1777277160.392681, 'has_photos': True, 'auction_closing_time': 1777388911.0}
2026-04-27 08:06:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_190db6c23d17491c8c6486dd64c9f69e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_de20d71b7c6c94bca414614181b94316.jpg not downloaded yet
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_be67b456b0f30d9d1f66e37d56954a62.jpg not downloaded yet
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: CF78450
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for CF78450: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: FW29244
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for FW29244: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: AK30543
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for AK30543: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: UR17084
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for UR17084: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: WL63923
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for WL63923: 1
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5962490>
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:06:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_190db6c23d17491c8c6486dd64c9f69e.jpg saved to cache
2026-04-27 08:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: FL08980
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for FL08980: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: BF50858
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for BF50858: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: KK79184
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for KK79184: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: TK51874
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for TK51874: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: PW70389
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for PW70389: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: NJ15500
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for NJ15500: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: AA32555
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for AA32555: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: CY87158
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for CY87158: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: YL89014
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for YL89014: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: JH97185
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for JH97185: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: BR14904
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for BR14904: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: LP60965
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for LP60965: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: SS01622
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for SS01622: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: FL27850
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for FL27850: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: DZ95846
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for DZ95846: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: JN62828
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for JN62828: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: BA67590
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for BA67590: 1
2026-04-27 08:06:00 [auto1.it] INFO: Found listing with ID: KD52940
2026-04-27 08:06:00 [auto1.it] INFO: Scrape type for KD52940: 1
2026-04-27 08:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MA72760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:03 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.371(s), this was the 1st time calling it.
2026-04-27 08:06:03 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.6834399266071305 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ16144/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:06:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:06:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:06:10 [scrapy.extensions.logstats] INFO: Crawled 538 pages (at 24 pages/min), scraped 229 items (at 12 items/min)
2026-04-27 08:06:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:06:28 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.503(s), this was the 1st time calling it.
2026-04-27 08:06:28 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.957361189827609 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:06:40 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.695(s), this was the 1st time calling it.
2026-04-27 08:06:40 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.914205840788396 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:44 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.876(s), this was the 1st time calling it.
2026-04-27 08:06:44 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.930948313606202 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:06:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:06:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:07:10 [scrapy.extensions.logstats] INFO: Crawled 538 pages (at 0 pages/min), scraped 229 items (at 0 items/min)
2026-04-27 08:07:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HN68081> (referer: https://www.auto1.com/v1/car-details-view/HN68081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c0b1652-be2c-503b-b082-1e88799b937b with identifier: HN68081
2026-04-27 08:07:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c0b1652-be2c-503b-b082-1e88799b937b with scrape type 1
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_41210509a5601a9be412c6832ca12535.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_3dd109bc0f61710d5b7965ffce9bf122.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_5383a0c07b2dd4183d1defd3794079e6.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_226750edf0373c1208b8c08e02b680fb.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7157319dc5af497f90ec27ac989450ff.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b4c50a7ddcf8bd29392ebd91bde47760.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b6dcc0fcfed6a03d74eefcfa062e25f0.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_a690e9b9000ef3112abf2f4240c1910d.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_96dda9a8cc7ae98b3529ab737e182401.jpg not downloaded yet
2026-04-27 08:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7f4884f640e42fa0f041140f6a8861e3.jpg not downloaded yet
2026-04-27 08:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RE95163> (referer: https://www.auto1.com/v1/car-details-view/RE95163/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with identifier: RE95163
2026-04-27 08:07:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with scrape type 1
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ec8e4830dc492f5f923b7cf1ab7c1788.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7b128df6d973e3881c33e3e8ced3fc8.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_b974b87aa6734489b249acf0e6eb57bc.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7597abda669daf6b1caf2902f33c9e6.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_fe352bf0d6d2bf1799d6ec2494a3d997.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_c0ab2d8102b33be59a3c274761af88c6.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ca0e426e865283ce4a613e632c81c22e.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_4923dbec9426ecfaa64fe0539107b57b.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_e7b75014df7b9742535824e2bb792d20.jpg not downloaded yet
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_52659d255e1f6d73f259ad556c2a3bba.jpg not downloaded yet
2026-04-27 08:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7f4884f640e42fa0f041140f6a8861e3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59612d0>
2026-04-27 08:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7f4884f640e42fa0f041140f6a8861e3.jpg saved to cache
2026-04-27 08:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_52659d255e1f6d73f259ad556c2a3bba.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3f550>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_52659d255e1f6d73f259ad556c2a3bba.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_e7b75014df7b9742535824e2bb792d20.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533a2d0>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_e7b75014df7b9742535824e2bb792d20.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_4923dbec9426ecfaa64fe0539107b57b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ed50>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_4923dbec9426ecfaa64fe0539107b57b.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JA34507/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ca0e426e865283ce4a613e632c81c22e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559f510>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ca0e426e865283ce4a613e632c81c22e.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_fe352bf0d6d2bf1799d6ec2494a3d997.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_c0ab2d8102b33be59a3c274761af88c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5050>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_fe352bf0d6d2bf1799d6ec2494a3d997.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0b50>
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_c0ab2d8102b33be59a3c274761af88c6.jpg saved to cache
2026-04-27 08:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7597abda669daf6b1caf2902f33c9e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5508c50>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7597abda669daf6b1caf2902f33c9e6.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_b974b87aa6734489b249acf0e6eb57bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486150>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_b974b87aa6734489b249acf0e6eb57bc.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7b128df6d973e3881c33e3e8ced3fc8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ec8e4830dc492f5f923b7cf1ab7c1788.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664f50>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7b128df6d973e3881c33e3e8ced3fc8.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_96dda9a8cc7ae98b3529ab737e182401.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3fdd0>
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ec8e4830dc492f5f923b7cf1ab7c1788.jpg saved to cache
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71
2026-04-27 08:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa8d611a-9ab8-52dc-8fb9-424bd0802a71, skipping ID generation
2026-04-27 08:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with scrape type 1
2026-04-27 08:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa8d611a-9ab8-52dc-8fb9-424bd0802a71 sending to next pipeline
2026-04-27 08:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fa8d611a-9ab8-52dc-8fb9-424bd0802a71, identifier: RE95163
2026-04-27 08:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with identifier: RE95163
2026-04-27 08:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with identifier: RE95163
2026-04-27 08:07:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fa8d611a-9ab8-52dc-8fb9-424bd0802a71 with identifier: RE95163 to the API
2026-04-27 08:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ec8e4830dc492f5f923b7cf1ab7c1788.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'category': None,
'city': 'Milazzo',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.0L',
'engine_horse_power': 63,
'expiration_date': '2026-04-28T15:11:05Z',
'fuel_type': 'petrol',
'id': 'fa8d611a-9ab8-52dc-8fb9-424bd0802a71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RE95163',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Hyundai',
'model': 'i10',
'odometer': 4371,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65767,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ec8e4830dc492f5f923b7cf1ab7c1788.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7b128df6d973e3881c33e3e8ced3fc8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_b974b87aa6734489b249acf0e6eb57bc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 35525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_a7597abda669daf6b1caf2902f33c9e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52046,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_fe352bf0d6d2bf1799d6ec2494a3d997.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66975,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_c0ab2d8102b33be59a3c274761af88c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43577,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_ca0e426e865283ce4a613e632c81c22e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65232,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_4923dbec9426ecfaa64fe0539107b57b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_e7b75014df7b9742535824e2bb792d20.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fa8d611a-9ab8-52dc-8fb9-424bd0802a71/fa8d611a-9ab8-52dc-8fb9-424bd0802a71_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge3/90/e390cc0c2700d540100b3b5d73fac806/pa/RE95163_52659d255e1f6d73f259ad556c2a3bba.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2025-03-10',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai i10 1.0 Connectline',
'transmission': 'manual',
'trim': 'Connectline',
'year': 2025}
2026-04-27 08:07:27 [auto1.it] INFO: Saving data for RE95163: {'created_time': 1777277247.141335, 'last_price_update_time': 1777277247.141348, 'has_photos': True, 'auction_closing_time': 1777389065.0}
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_a690e9b9000ef3112abf2f4240c1910d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a1b90>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_96dda9a8cc7ae98b3529ab737e182401.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551fed0>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_a690e9b9000ef3112abf2f4240c1910d.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b6dcc0fcfed6a03d74eefcfa062e25f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bb4d0>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b6dcc0fcfed6a03d74eefcfa062e25f0.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b4c50a7ddcf8bd29392ebd91bde47760.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a02e10>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b4c50a7ddcf8bd29392ebd91bde47760.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7157319dc5af497f90ec27ac989450ff.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555a190>
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7157319dc5af497f90ec27ac989450ff.jpg saved to cache
2026-04-27 08:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_226750edf0373c1208b8c08e02b680fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55106d0>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_226750edf0373c1208b8c08e02b680fb.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_5383a0c07b2dd4183d1defd3794079e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL11319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_41210509a5601a9be412c6832ca12535.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649cdd0>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_5383a0c07b2dd4183d1defd3794079e6.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533af90>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_41210509a5601a9be412c6832ca12535.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_3dd109bc0f61710d5b7965ffce9bf122.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665710>
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_3dd109bc0f61710d5b7965ffce9bf122.jpg saved to cache
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4c0b1652-be2c-503b-b082-1e88799b937b
2026-04-27 08:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c0b1652-be2c-503b-b082-1e88799b937b, skipping ID generation
2026-04-27 08:07:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c0b1652-be2c-503b-b082-1e88799b937b with scrape type 1
2026-04-27 08:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4c0b1652-be2c-503b-b082-1e88799b937b sending to next pipeline
2026-04-27 08:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4c0b1652-be2c-503b-b082-1e88799b937b, identifier: HN68081
2026-04-27 08:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4c0b1652-be2c-503b-b082-1e88799b937b with identifier: HN68081
2026-04-27 08:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4c0b1652-be2c-503b-b082-1e88799b937b with identifier: HN68081
2026-04-27 08:07:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4c0b1652-be2c-503b-b082-1e88799b937b with identifier: HN68081 to the API
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:28 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_3dd109bc0f61710d5b7965ffce9bf122.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Milazzo',
'color': 'yellow',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-04-28T15:56:40Z',
'fuel_type': 'petrol',
'id': '4c0b1652-be2c-503b-b082-1e88799b937b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HN68081',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Peugeot',
'model': '208',
'odometer': 13670,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72845,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_41210509a5601a9be412c6832ca12535.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63742,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_3dd109bc0f61710d5b7965ffce9bf122.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_5383a0c07b2dd4183d1defd3794079e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_226750edf0373c1208b8c08e02b680fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59737,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7157319dc5af497f90ec27ac989450ff.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62032,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b4c50a7ddcf8bd29392ebd91bde47760.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50139,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_b6dcc0fcfed6a03d74eefcfa062e25f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_a690e9b9000ef3112abf2f4240c1910d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_96dda9a8cc7ae98b3529ab737e182401.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4c0b1652-be2c-503b-b082-1e88799b937b/4c0b1652-be2c-503b-b082-1e88799b937b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img02/56/0256c8cc0032209d6d50806c0c912455/pa/HN68081_7f4884f640e42fa0f041140f6a8861e3.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2024-02-12',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Active',
'transmission': 'manual',
'trim': 'Active',
'year': 2024}
2026-04-27 08:07:28 [auto1.it] INFO: Saving data for HN68081: {'created_time': 1777277248.960261, 'last_price_update_time': 1777277248.96028, 'has_photos': True, 'auction_closing_time': 1777391800.0}
2026-04-27 08:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES07755> (referer: https://www.auto1.com/v1/car-details-view/ES07755/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b266da-5045-5dd7-a832-6d2151c27a7e with identifier: ES07755
2026-04-27 08:07:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b266da-5045-5dd7-a832-6d2151c27a7e with scrape type 1
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_f2ffe33460eed6e950bfcc483de19aaa.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_72621bbf7c43be4cc0251956c2ccf3c0.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_16f56c39fb1fc94aaecbb8616ca8a8d9.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_94de01fab77855abc72a14c669d22a0b.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_44eee1bf11c0c396fe0a98129547a71b.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_709c80c9027050a01070ce8e44ce0aa2.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_78736e530a65c46a849e8b319a5a89df.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_166b6b7d6080280a0a2da10b25987c4e.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_452ee55cfc5abeeb9e17db6737dcf593.jpg not downloaded yet
2026-04-27 08:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_211078b07be28a8d4986f9953322b383.jpg not downloaded yet
2026-04-27 08:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CV66158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_211078b07be28a8d4986f9953322b383.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f5010>
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_211078b07be28a8d4986f9953322b383.jpg saved to cache
2026-04-27 08:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SG75657/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_452ee55cfc5abeeb9e17db6737dcf593.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b3790>
2026-04-27 08:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:41 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_452ee55cfc5abeeb9e17db6737dcf593.jpg saved to cache
2026-04-27 08:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD52940/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_166b6b7d6080280a0a2da10b25987c4e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f7f50>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_166b6b7d6080280a0a2da10b25987c4e.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_78736e530a65c46a849e8b319a5a89df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a0e90>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_78736e530a65c46a849e8b319a5a89df.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GZ99467/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_709c80c9027050a01070ce8e44ce0aa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59d9950>
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_709c80c9027050a01070ce8e44ce0aa2.jpg saved to cache
2026-04-27 08:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MA72760> (referer: https://www.auto1.com/v1/car-details-view/MA72760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-04-27 08:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with scrape type 1
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg not downloaded yet
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_44eee1bf11c0c396fe0a98129547a71b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg not downloaded yet
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a0410>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_44eee1bf11c0c396fe0a98129547a71b.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551ec50>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ16144> (referer: https://www.auto1.com/v1/car-details-view/TJ16144/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ce094d22-ad83-5e33-9336-34892977f255 with identifier: TJ16144
2026-04-27 08:07:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce094d22-ad83-5e33-9336-34892977f255 with scrape type 1
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_562e13e8cc6511dcb2868cb9768ab3e2.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_61a73648d3c2de2854d53670a07bae80.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_5d466b0d7818241ac079594f1d5941a2.jpg not downloaded yet
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95890>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_fd48a7ff21cdc9593496e43f478edc63.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_359ea6278fe15ac72833c12916a27602.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_1a75d25ed7f8012aa5e01214266eb15e.jpg not downloaded yet
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7590>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5498610>
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg saved to cache
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_4dca5e9aa412fd466b39a58bf36270cc.jpg not downloaded yet
2026-04-27 08:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b17d2d113d5d64002fd1c0b9e659e113.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b19af3e9794b7241e0f0d7c1d48ebc97.jpg not downloaded yet
2026-04-27 08:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_8f7b848b00d703cb55078f59e4c62428.jpg not downloaded yet
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564dc90>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550f590>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_359ea6278fe15ac72833c12916a27602.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_1a75d25ed7f8012aa5e01214266eb15e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a53d50>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_359ea6278fe15ac72833c12916a27602.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b19af3e9794b7241e0f0d7c1d48ebc97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_8f7b848b00d703cb55078f59e4c62428.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5513c90>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_1a75d25ed7f8012aa5e01214266eb15e.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b17d2d113d5d64002fd1c0b9e659e113.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564f990>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b19af3e9794b7241e0f0d7c1d48ebc97.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817b10>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_8f7b848b00d703cb55078f59e4c62428.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ae790>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b17d2d113d5d64002fd1c0b9e659e113.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_4dca5e9aa412fd466b39a58bf36270cc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_fd48a7ff21cdc9593496e43f478edc63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5593e10>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_4dca5e9aa412fd466b39a58bf36270cc.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_5d466b0d7818241ac079594f1d5941a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555ad50>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_fd48a7ff21cdc9593496e43f478edc63.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_562e13e8cc6511dcb2868cb9768ab3e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762d90>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_5d466b0d7818241ac079594f1d5941a2.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_61a73648d3c2de2854d53670a07bae80.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5509ed0>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_562e13e8cc6511dcb2868cb9768ab3e2.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549b990>
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_61a73648d3c2de2854d53670a07bae80.jpg saved to cache
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ce094d22-ad83-5e33-9336-34892977f255
2026-04-27 08:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ce094d22-ad83-5e33-9336-34892977f255, skipping ID generation
2026-04-27 08:07:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ce094d22-ad83-5e33-9336-34892977f255 with scrape type 1
2026-04-27 08:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ce094d22-ad83-5e33-9336-34892977f255 sending to next pipeline
2026-04-27 08:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ce094d22-ad83-5e33-9336-34892977f255, identifier: TJ16144
2026-04-27 08:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ce094d22-ad83-5e33-9336-34892977f255 with identifier: TJ16144
2026-04-27 08:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ce094d22-ad83-5e33-9336-34892977f255 with identifier: TJ16144
2026-04-27 08:07:51 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ce094d22-ad83-5e33-9336-34892977f255 with identifier: TJ16144 to the API
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_61a73648d3c2de2854d53670a07bae80.jpg>
{'auction_title': '',
'c_o_2_emission_value': 149,
'category': None,
'city': 'Varedo',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6C',
'engine': '1.6L',
'engine_horse_power': 114,
'expiration_date': '2026-04-28T15:52:58Z',
'fuel_type': 'petrol',
'id': 'ce094d22-ad83-5e33-9336-34892977f255',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ16144',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Dacia',
'model': 'Duster',
'odometer': 56059,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55132,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_562e13e8cc6511dcb2868cb9768ab3e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52192,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_61a73648d3c2de2854d53670a07bae80.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52930,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_5d466b0d7818241ac079594f1d5941a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47521,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_fd48a7ff21cdc9593496e43f478edc63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46844,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_359ea6278fe15ac72833c12916a27602.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59528,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_1a75d25ed7f8012aa5e01214266eb15e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60056,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_4dca5e9aa412fd466b39a58bf36270cc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66854,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b17d2d113d5d64002fd1c0b9e659e113.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59319,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_b19af3e9794b7241e0f0d7c1d48ebc97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ce094d22-ad83-5e33-9336-34892977f255/ce094d22-ad83-5e33-9336-34892977f255_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3b/58/3b589ffe3b5426d1fe23f6294fda12ad/pa/TJ16144_8f7b848b00d703cb55078f59e4c62428.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Duster 1.6 SCe Techroad',
'transmission': 'manual',
'trim': 'Techroad',
'year': 2019}
2026-04-27 08:07:51 [auto1.it] INFO: Saving data for TJ16144: {'created_time': 1777277271.537418, 'last_price_update_time': 1777277271.537431, 'has_photos': True, 'auction_closing_time': 1777391578.0}
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649f290>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5816bd0>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555b4d0>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563fc50>
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg saved to cache
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5
2026-04-27 08:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c8e1611-7aae-53be-b668-d7bc75c34ef5, skipping ID generation
2026-04-27 08:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with scrape type 1
2026-04-27 08:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c8e1611-7aae-53be-b668-d7bc75c34ef5 sending to next pipeline
2026-04-27 08:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6c8e1611-7aae-53be-b668-d7bc75c34ef5, identifier: MA72760
2026-04-27 08:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-04-27 08:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760
2026-04-27 08:07:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6c8e1611-7aae-53be-b668-d7bc75c34ef5 with identifier: MA72760 to the API
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.1L',
'engine_horse_power': 210,
'expiration_date': '2026-04-28T15:02:04Z',
'fuel_type': 'diesel',
'id': '6c8e1611-7aae-53be-b668-d7bc75c34ef5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA72760',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Alfa Romeo',
'model': 'Stelvio',
'odometer': 200055,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69653,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_5b224e70438699947c2484d98ba61afe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_397afbe7d655c54747fa990da6f7823a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_aa4f3f1e8d12143e94b748953e69e108.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63395,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c2ade1bde876d26b548b61e9e99ab059.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_4b1154cc1669d52272a78ed853f7a6c7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73305,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_f194de2c5f1400ff8f71e7feb6c774c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63870,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_c3e6d748b61429363873d5af0f689dd5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_320a7043e9ab251284d5862c2f9adf86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67892,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_153d068a5f180d7c000b29789a074a76.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6c8e1611-7aae-53be-b668-d7bc75c34ef5/6c8e1611-7aae-53be-b668-d7bc75c34ef5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100614,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img57/91/5791b8b116079a142cf782791cb5158f/pa/MA72760_af23ccbbaef8dc8d3ff49793914e4977.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2017-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Stelvio 2.2 JTDM Executive Q4',
'transmission': 'automatic',
'trim': 'Executive Q4',
'year': 2017}
2026-04-27 08:07:52 [auto1.it] INFO: Saving data for MA72760: {'created_time': 1777277272.312118, 'last_price_update_time': 1777277272.312129, 'has_photos': True, 'auction_closing_time': 1777388524.0}
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_94de01fab77855abc72a14c669d22a0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_16f56c39fb1fc94aaecbb8616ca8a8d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551cc90>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_94de01fab77855abc72a14c669d22a0b.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8dd0>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_16f56c39fb1fc94aaecbb8616ca8a8d9.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_f2ffe33460eed6e950bfcc483de19aaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_72621bbf7c43be4cc0251956c2ccf3c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5550>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_f2ffe33460eed6e950bfcc483de19aaa.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5499bd0>
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_72621bbf7c43be4cc0251956c2ccf3c0.jpg saved to cache
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56b266da-5045-5dd7-a832-6d2151c27a7e
2026-04-27 08:07:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56b266da-5045-5dd7-a832-6d2151c27a7e, skipping ID generation
2026-04-27 08:07:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b266da-5045-5dd7-a832-6d2151c27a7e with scrape type 1
2026-04-27 08:07:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56b266da-5045-5dd7-a832-6d2151c27a7e sending to next pipeline
2026-04-27 08:07:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 56b266da-5045-5dd7-a832-6d2151c27a7e, identifier: ES07755
2026-04-27 08:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 56b266da-5045-5dd7-a832-6d2151c27a7e with identifier: ES07755
2026-04-27 08:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 56b266da-5045-5dd7-a832-6d2151c27a7e with identifier: ES07755
2026-04-27 08:07:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 56b266da-5045-5dd7-a832-6d2151c27a7e with identifier: ES07755 to the API
2026-04-27 08:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:07:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_72621bbf7c43be4cc0251956c2ccf3c0.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Padova',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:15:43Z',
'fuel_type': 'diesel',
'id': '56b266da-5045-5dd7-a832-6d2151c27a7e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES07755',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Land Rover',
'model': 'Discovery Sport',
'odometer': 15982,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60073,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_f2ffe33460eed6e950bfcc483de19aaa.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_72621bbf7c43be4cc0251956c2ccf3c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62078,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_16f56c39fb1fc94aaecbb8616ca8a8d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 34976,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_94de01fab77855abc72a14c669d22a0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56955,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_44eee1bf11c0c396fe0a98129547a71b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59716,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_709c80c9027050a01070ce8e44ce0aa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51685,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_78736e530a65c46a849e8b319a5a89df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_166b6b7d6080280a0a2da10b25987c4e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59784,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_452ee55cfc5abeeb9e17db6737dcf593.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_56b266da-5045-5dd7-a832-6d2151c27a7e/56b266da-5045-5dd7-a832-6d2151c27a7e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img74/80/7480cd4ffc579c9dae96570859789852/pa/ES07755_211078b07be28a8d4986f9953322b383.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2020-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Land Rover Discovery Sport D150 S FWD',
'transmission': 'manual',
'trim': 'S FWD',
'year': 2020}
2026-04-27 08:07:53 [auto1.it] INFO: Saving data for ES07755: {'created_time': 1777277273.125307, 'last_price_update_time': 1777277273.125319, 'has_photos': True, 'auction_closing_time': 1777389343.0}
2026-04-27 08:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA67590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL11319> (referer: https://www.auto1.com/v1/car-details-view/GL11319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:07:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b5af828-2527-5082-807b-981548232ffe with identifier: GL11319
2026-04-27 08:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b5af828-2527-5082-807b-981548232ffe with scrape type 1
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_69046b68e173e2234cb4a5f8d2cca9d3.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_c0aecc52a68298f2e74e13ee3178b683.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_3aa41addbcdcc26ed9a991c07e8c075c.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_dcc4b1f5cdd2cc363812eef7d16e77d3.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_5e33b72a55f66dcde78124d80ee8fc48.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_d44df1f5d87424add79a54a1ef494b92.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_de2300fb66cdd91063cb23d7c31e00ad.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_80f8ee425df7d178662bb9d0dc60bc55.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_f19f0e5c705832e7f8aad4f857ea81b8.jpg not downloaded yet
2026-04-27 08:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_728a20626716e77eb24f7f27e54ef2cd.jpg not downloaded yet
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.103(s), this was the 1st time calling it.
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.195611246412198 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.622(s), this was the 1st time calling it.
2026-04-27 08:08:08 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.199932474122577 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:10 [scrapy.extensions.logstats] INFO: Crawled 551 pages (at 13 pages/min), scraped 234 items (at 5 items/min)
2026-04-27 08:08:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.266(s), this was the 1st time calling it.
2026-04-27 08:08:10 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.363071566268941 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NK66633> (referer: https://www.auto1.com/v1/car-details-view/NK66633/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c726e22-3c20-592c-9743-d0c548de4713 with identifier: NK66633
2026-04-27 08:08:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c726e22-3c20-592c-9743-d0c548de4713 with scrape type 1
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_2d13ff6e2e4a4fb50af00bdb4e6acbab.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_f3da3cfbeb291b075be850fd3f7c1549.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_7d5d60f75bb8fa2fca3101cac70aa6bd.jpg not downloaded yet
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_728a20626716e77eb24f7f27e54ef2cd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_37c4969d61ba924a33b608390f826cb1.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_3248740ef36aecf65054f3a12aba06d4.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d4fea3afbbc1265cb696bdd3a9560ae4.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_a09e338c024fe9016abbeae5c24d2bd7.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4db0ffbe0e5b0dcdb62b9b404d401d06.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4df485300d8431567e3e989b42709ac9.jpg not downloaded yet
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d455fe562fe9fa0c6336eac72820e7db.jpg not downloaded yet
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5890>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_728a20626716e77eb24f7f27e54ef2cd.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_7d5d60f75bb8fa2fca3101cac70aa6bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d455fe562fe9fa0c6336eac72820e7db.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4df485300d8431567e3e989b42709ac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1590>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_7d5d60f75bb8fa2fca3101cac70aa6bd.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4db0ffbe0e5b0dcdb62b9b404d401d06.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594fd90>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d455fe562fe9fa0c6336eac72820e7db.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53384d0>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4df485300d8431567e3e989b42709ac9.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647f10>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4db0ffbe0e5b0dcdb62b9b404d401d06.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_a09e338c024fe9016abbeae5c24d2bd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57614d0>
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_a09e338c024fe9016abbeae5c24d2bd7.jpg saved to cache
2026-04-27 08:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SD72417/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d4fea3afbbc1265cb696bdd3a9560ae4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_37c4969d61ba924a33b608390f826cb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533bad0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d4fea3afbbc1265cb696bdd3a9560ae4.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_3248740ef36aecf65054f3a12aba06d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763d90>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_37c4969d61ba924a33b608390f826cb1.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_f3da3cfbeb291b075be850fd3f7c1549.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1350>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_3248740ef36aecf65054f3a12aba06d4.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_2d13ff6e2e4a4fb50af00bdb4e6acbab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760bd0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_f3da3cfbeb291b075be850fd3f7c1549.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a09d0>
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_2d13ff6e2e4a4fb50af00bdb4e6acbab.jpg saved to cache
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1c726e22-3c20-592c-9743-d0c548de4713
2026-04-27 08:08:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1c726e22-3c20-592c-9743-d0c548de4713, skipping ID generation
2026-04-27 08:08:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c726e22-3c20-592c-9743-d0c548de4713 with scrape type 1
2026-04-27 08:08:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1c726e22-3c20-592c-9743-d0c548de4713 sending to next pipeline
2026-04-27 08:08:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1c726e22-3c20-592c-9743-d0c548de4713, identifier: NK66633
2026-04-27 08:08:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1c726e22-3c20-592c-9743-d0c548de4713 with identifier: NK66633
2026-04-27 08:08:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1c726e22-3c20-592c-9743-d0c548de4713 with identifier: NK66633
2026-04-27 08:08:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1c726e22-3c20-592c-9743-d0c548de4713 with identifier: NK66633 to the API
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_2d13ff6e2e4a4fb50af00bdb4e6acbab.jpg>
{'auction_title': '',
'c_o_2_emission_value': 158,
'category': None,
'city': 'Decimomannu',
'color': 'blue',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 313,
'expiration_date': '2026-04-28T15:41:52Z',
'fuel_type': 'diesel',
'id': '1c726e22-3c20-592c-9743-d0c548de4713',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 39.3103,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK66633',
'listing': 'auction',
'location': 'IT, DECIMOMANNU (CA)',
'location_confidence': 'geocoded',
'longitude': 8.9696,
'make': 'BMW',
'model': '6er',
'odometer': 164822,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_2d13ff6e2e4a4fb50af00bdb4e6acbab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_f3da3cfbeb291b075be850fd3f7c1549.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103282,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_7d5d60f75bb8fa2fca3101cac70aa6bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_37c4969d61ba924a33b608390f826cb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97830,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_3248740ef36aecf65054f3a12aba06d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d4fea3afbbc1265cb696bdd3a9560ae4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_a09e338c024fe9016abbeae5c24d2bd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4db0ffbe0e5b0dcdb62b9b404d401d06.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99670,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_4df485300d8431567e3e989b42709ac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1c726e22-3c20-592c-9743-d0c548de4713/1c726e22-3c20-592c-9743-d0c548de4713_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/17/061788c0bc6b6d054e8980785e4fff2b/pa/NK66633_d455fe562fe9fa0c6336eac72820e7db.jpg',
'Width': 800}],
'postal_code': '09033',
'price': 0,
'price_includes_vat': True,
'province': 'Cagliari',
'province_code': 'IT-CA',
'region': 'Sardegna',
'region_code': 'IT-14',
'registration_date': '2015-09-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 6er 640d Gran Coupé xDrive',
'transmission': 'automatic',
'trim': 'xDrive',
'year': 2015}
2026-04-27 08:08:18 [auto1.it] INFO: Saving data for NK66633: {'created_time': 1777277298.981356, 'last_price_update_time': 1777277298.981367, 'has_photos': True, 'auction_closing_time': 1777390912.0}
2026-04-27 08:08:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_f19f0e5c705832e7f8aad4f857ea81b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.270(s), this was the 1st time calling it.
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.011637121068498 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 265.641(s), this was the 2nd time calling it.
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.1036649605401045 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551db90>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_f19f0e5c705832e7f8aad4f857ea81b8.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_80f8ee425df7d178662bb9d0dc60bc55.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54989d0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_80f8ee425df7d178662bb9d0dc60bc55.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_de2300fb66cdd91063cb23d7c31e00ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d56d0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_de2300fb66cdd91063cb23d7c31e00ad.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_d44df1f5d87424add79a54a1ef494b92.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5458cd0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_d44df1f5d87424add79a54a1ef494b92.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_5e33b72a55f66dcde78124d80ee8fc48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6f10>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_5e33b72a55f66dcde78124d80ee8fc48.jpg saved to cache
2026-04-27 08:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_dcc4b1f5cdd2cc363812eef7d16e77d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC90942> (referer: https://www.auto1.com/v1/car-details-view/RC90942/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_c0aecc52a68298f2e74e13ee3178b683.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_69046b68e173e2234cb4a5f8d2cca9d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e71d0>
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_dcc4b1f5cdd2cc363812eef7d16e77d3.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_3aa41addbcdcc26ed9a991c07e8c075c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc362e70-fcc1-5e80-baf6-fe271add8b0c with identifier: RC90942
2026-04-27 08:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc362e70-fcc1-5e80-baf6-fe271add8b0c with scrape type 1
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_4ff459c2acd9f91eb86c130b9fb50bb7.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_617da3a8111f7094ffbf03af00cea7d4.jpg not downloaded yet
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_6529142f2e26489b086ed9e32b7b9acb.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577b290>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_c0aecc52a68298f2e74e13ee3178b683.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_d0929ba4dd205aa5278d7812541f8fa7.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547ff10>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_69046b68e173e2234cb4a5f8d2cca9d3.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_ae28f69a0bc51b60e68c276b652b3ba4.jpg not downloaded yet
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54ddd10>
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_3aa41addbcdcc26ed9a991c07e8c075c.jpg saved to cache
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9b5af828-2527-5082-807b-981548232ffe
2026-04-27 08:08:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9b5af828-2527-5082-807b-981548232ffe, skipping ID generation
2026-04-27 08:08:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b5af828-2527-5082-807b-981548232ffe with scrape type 1
2026-04-27 08:08:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9b5af828-2527-5082-807b-981548232ffe sending to next pipeline
2026-04-27 08:08:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9b5af828-2527-5082-807b-981548232ffe, identifier: GL11319
2026-04-27 08:08:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9b5af828-2527-5082-807b-981548232ffe with identifier: GL11319
2026-04-27 08:08:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9b5af828-2527-5082-807b-981548232ffe with identifier: GL11319
2026-04-27 08:08:20 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9b5af828-2527-5082-807b-981548232ffe with identifier: GL11319 to the API
2026-04-27 08:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_3aa41addbcdcc26ed9a991c07e8c075c.jpg>
{'auction_title': '',
'c_o_2_emission_value': 141,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:44:35Z',
'fuel_type': 'diesel',
'id': '9b5af828-2527-5082-807b-981548232ffe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL11319',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Skoda',
'model': 'Kodiaq',
'odometer': 172952,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_69046b68e173e2234cb4a5f8d2cca9d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_c0aecc52a68298f2e74e13ee3178b683.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_3aa41addbcdcc26ed9a991c07e8c075c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60917,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_dcc4b1f5cdd2cc363812eef7d16e77d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52587,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_5e33b72a55f66dcde78124d80ee8fc48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_d44df1f5d87424add79a54a1ef494b92.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57049,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_de2300fb66cdd91063cb23d7c31e00ad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68333,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_80f8ee425df7d178662bb9d0dc60bc55.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62970,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_f19f0e5c705832e7f8aad4f857ea81b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9b5af828-2527-5082-807b-981548232ffe/9b5af828-2527-5082-807b-981548232ffe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70285,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc1/0a/c10abbf3b8b368ab29986a4a3a8198ef/pa/GL11319_728a20626716e77eb24f7f27e54ef2cd.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2022-05-22',
'seats_number': 7,
'seller_name': None,
'title': 'Skoda Kodiaq 2.0 TDI Ambition',
'transmission': 'automatic',
'trim': 'Ambition',
'year': 2022}
2026-04-27 08:08:21 [auto1.it] INFO: Saving data for GL11319: {'created_time': 1777277301.159006, 'last_price_update_time': 1777277301.159017, 'has_photos': True, 'auction_closing_time': 1777391075.0}
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD52940> (referer: https://www.auto1.com/v1/car-details-view/KD52940/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a8b242f-4a26-5c38-bb33-bec374f91001 with identifier: KD52940
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8b242f-4a26-5c38-bb33-bec374f91001 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_7de198b3542f5cd19dabaa1e8063b4d6.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_c442f1df3a1d081ef1adfcee3984eba7.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_41147025c8631ae38e9685d92fbb384d.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_36c1cc8abd9c423aa405b592c0652091.jpg not downloaded yet
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SG75657> (referer: https://www.auto1.com/v1/car-details-view/SG75657/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_a45678fb3e7060762ac3eaa962ff0db4.jpg not downloaded yet
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_ae28f69a0bc51b60e68c276b652b3ba4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_0e4c6504acb5b81466e9c28a4cc42aad.jpg not downloaded yet
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_41147025c8631ae38e9685d92fbb384d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-04-27 08:08:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with scrape type 1
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_26a3286895024255c025224faa1a6314.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_402f7d352a93c87bf2c9a217f8b96254.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_aacc5b6df81138725c9bb78ed1a3ae95.jpg not downloaded yet
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a0e10>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_ae28f69a0bc51b60e68c276b652b3ba4.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_d1ad461f171a0d01160b7a37b1e18c46.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_f48af18b3dbfba0ae30c4d09faee9fec.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_75094ecb6c37feb7ade1f190dd09b7b8.jpg not downloaded yet
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b2f10>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_41147025c8631ae38e9685d92fbb384d.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_0e4c6504acb5b81466e9c28a4cc42aad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_6c79f0384954ec8bfcf3356a42784c1e.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3bbf99f23c62051feeddedefae25e82f.jpg not downloaded yet
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_a45678fb3e7060762ac3eaa962ff0db4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3628be6b4b2deff381981827a2f47fd9.jpg not downloaded yet
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_4468dd301c8e2732f402b1f76e5cc7ae.jpg not downloaded yet
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550c8d0>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_0e4c6504acb5b81466e9c28a4cc42aad.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567ec90>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_a45678fb3e7060762ac3eaa962ff0db4.jpg saved to cache
2026-04-27 08:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_75094ecb6c37feb7ade1f190dd09b7b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3bbf99f23c62051feeddedefae25e82f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664a10>
2026-04-27 08:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_75094ecb6c37feb7ade1f190dd09b7b8.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5786b90>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3bbf99f23c62051feeddedefae25e82f.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_4468dd301c8e2732f402b1f76e5cc7ae.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5784e10>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_4468dd301c8e2732f402b1f76e5cc7ae.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3628be6b4b2deff381981827a2f47fd9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_6c79f0384954ec8bfcf3356a42784c1e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665dd0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3628be6b4b2deff381981827a2f47fd9.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667210>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_6c79f0384954ec8bfcf3356a42784c1e.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_f48af18b3dbfba0ae30c4d09faee9fec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_d1ad461f171a0d01160b7a37b1e18c46.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a51a10>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_f48af18b3dbfba0ae30c4d09faee9fec.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564d310>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_d1ad461f171a0d01160b7a37b1e18c46.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_aacc5b6df81138725c9bb78ed1a3ae95.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_26a3286895024255c025224faa1a6314.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_402f7d352a93c87bf2c9a217f8b96254.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1ff10>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_aacc5b6df81138725c9bb78ed1a3ae95.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_c442f1df3a1d081ef1adfcee3984eba7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564ecd0>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_26a3286895024255c025224faa1a6314.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_7de198b3542f5cd19dabaa1e8063b4d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d350>
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_402f7d352a93c87bf2c9a217f8b96254.jpg saved to cache
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269
2026-04-27 08:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67f4c81d-f84a-5c7d-8b09-ce1d505db269, skipping ID generation
2026-04-27 08:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with scrape type 1
2026-04-27 08:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67f4c81d-f84a-5c7d-8b09-ce1d505db269 sending to next pipeline
2026-04-27 08:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 67f4c81d-f84a-5c7d-8b09-ce1d505db269, identifier: SG75657
2026-04-27 08:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-04-27 08:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657
2026-04-27 08:08:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 67f4c81d-f84a-5c7d-8b09-ce1d505db269 with identifier: SG75657 to the API
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_402f7d352a93c87bf2c9a217f8b96254.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'category': None,
'city': 'Capannori',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:38:37Z',
'fuel_type': 'diesel',
'id': '67f4c81d-f84a-5c7d-8b09-ce1d505db269',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG75657',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Renault',
'model': 'Megane',
'odometer': 135710,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108012,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_26a3286895024255c025224faa1a6314.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_402f7d352a93c87bf2c9a217f8b96254.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_aacc5b6df81138725c9bb78ed1a3ae95.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_d1ad461f171a0d01160b7a37b1e18c46.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_f48af18b3dbfba0ae30c4d09faee9fec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_75094ecb6c37feb7ade1f190dd09b7b8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74558,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_6c79f0384954ec8bfcf3356a42784c1e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3bbf99f23c62051feeddedefae25e82f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_3628be6b4b2deff381981827a2f47fd9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_67f4c81d-f84a-5c7d-8b09-ce1d505db269/67f4c81d-f84a-5c7d-8b09-ce1d505db269_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9a/44/9a4482b0da975d31ef57b89e01df8059/pa/SG75657_4468dd301c8e2732f402b1f76e5cc7ae.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2017-03-30',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 dCi Energy Intens',
'transmission': 'manual',
'trim': 'Intens',
'year': 2017}
2026-04-27 08:08:23 [auto1.it] INFO: Saving data for SG75657: {'created_time': 1777277303.584029, 'last_price_update_time': 1777277303.584038, 'has_photos': True, 'auction_closing_time': 1777390717.0}
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_36c1cc8abd9c423aa405b592c0652091.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_d0929ba4dd205aa5278d7812541f8fa7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c0f90>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_c442f1df3a1d081ef1adfcee3984eba7.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563c610>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_7de198b3542f5cd19dabaa1e8063b4d6.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba850>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_36c1cc8abd9c423aa405b592c0652091.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4a8b242f-4a26-5c38-bb33-bec374f91001
2026-04-27 08:08:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4a8b242f-4a26-5c38-bb33-bec374f91001, skipping ID generation
2026-04-27 08:08:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a8b242f-4a26-5c38-bb33-bec374f91001 with scrape type 1
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4a8b242f-4a26-5c38-bb33-bec374f91001 sending to next pipeline
2026-04-27 08:08:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4a8b242f-4a26-5c38-bb33-bec374f91001, identifier: KD52940
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5338cd0>
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_d0929ba4dd205aa5278d7812541f8fa7.jpg saved to cache
2026-04-27 08:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4a8b242f-4a26-5c38-bb33-bec374f91001 with identifier: KD52940
2026-04-27 08:08:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4a8b242f-4a26-5c38-bb33-bec374f91001 with identifier: KD52940
2026-04-27 08:08:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4a8b242f-4a26-5c38-bb33-bec374f91001 with identifier: KD52940 to the API
2026-04-27 08:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_36c1cc8abd9c423aa405b592c0652091.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': 'Milazzo',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:46:18Z',
'fuel_type': 'diesel',
'id': '4a8b242f-4a26-5c38-bb33-bec374f91001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD52940',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Peugeot',
'model': '207',
'odometer': 140182,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 6,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 115054,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_7de198b3542f5cd19dabaa1e8063b4d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_c442f1df3a1d081ef1adfcee3984eba7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_41147025c8631ae38e9685d92fbb384d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70954,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_36c1cc8abd9c423aa405b592c0652091.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101994,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_a45678fb3e7060762ac3eaa962ff0db4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4a8b242f-4a26-5c38-bb33-bec374f91001/4a8b242f-4a26-5c38-bb33-bec374f91001_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5a/c1/5ac1c04190c96c8951a720beb56e4988/pa/KD52940_0e4c6504acb5b81466e9c28a4cc42aad.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2008-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 207 1.4 HDi X-Line',
'transmission': 'manual',
'trim': 'X-Line',
'year': 2008}
2026-04-27 08:08:24 [auto1.it] INFO: Saving data for KD52940: {'created_time': 1777277304.198737, 'last_price_update_time': 1777277304.198747, 'has_photos': True, 'auction_closing_time': 1777391178.0}
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_617da3a8111f7094ffbf03af00cea7d4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_6529142f2e26489b086ed9e32b7b9acb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_4ff459c2acd9f91eb86c130b9fb50bb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54ae590>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_617da3a8111f7094ffbf03af00cea7d4.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5592810>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_6529142f2e26489b086ed9e32b7b9acb.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead83ad390>
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_4ff459c2acd9f91eb86c130b9fb50bb7.jpg saved to cache
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc362e70-fcc1-5e80-baf6-fe271add8b0c
2026-04-27 08:08:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc362e70-fcc1-5e80-baf6-fe271add8b0c, skipping ID generation
2026-04-27 08:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc362e70-fcc1-5e80-baf6-fe271add8b0c with scrape type 1
2026-04-27 08:08:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc362e70-fcc1-5e80-baf6-fe271add8b0c sending to next pipeline
2026-04-27 08:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dc362e70-fcc1-5e80-baf6-fe271add8b0c, identifier: RC90942
2026-04-27 08:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dc362e70-fcc1-5e80-baf6-fe271add8b0c with identifier: RC90942
2026-04-27 08:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dc362e70-fcc1-5e80-baf6-fe271add8b0c with identifier: RC90942
2026-04-27 08:08:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dc362e70-fcc1-5e80-baf6-fe271add8b0c with identifier: RC90942 to the API
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_4ff459c2acd9f91eb86c130b9fb50bb7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 132,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.4L',
'engine_horse_power': 90,
'expiration_date': '2026-04-28T15:18:45Z',
'fuel_type': 'diesel',
'id': 'dc362e70-fcc1-5e80-baf6-fe271add8b0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC90942',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Toyota',
'model': 'Auris',
'odometer': 243163,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82990,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_4ff459c2acd9f91eb86c130b9fb50bb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_617da3a8111f7094ffbf03af00cea7d4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_6529142f2e26489b086ed9e32b7b9acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68396,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_d0929ba4dd205aa5278d7812541f8fa7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dc362e70-fcc1-5e80-baf6-fe271add8b0c/dc362e70-fcc1-5e80-baf6-fe271add8b0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61603,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5f/e8/5fe81fe90eb159030bbdfb79c6e1de62/pa/RC90942_ae28f69a0bc51b60e68c276b652b3ba4.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2008-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'Toyota Auris 1.4 Turbodiesel',
'transmission': 'manual',
'trim': '',
'year': 2008}
2026-04-27 08:08:24 [auto1.it] INFO: Saving data for RC90942: {'created_time': 1777277304.923207, 'last_price_update_time': 1777277304.923217, 'has_photos': True, 'auction_closing_time': 1777389525.0}
2026-04-27 08:08:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:08:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CV66158> (referer: https://www.auto1.com/v1/car-details-view/CV66158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f327384d-87a8-5193-85c9-99af3374f455 with identifier: CV66158
2026-04-27 08:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f327384d-87a8-5193-85c9-99af3374f455 with scrape type 1
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_9814a404a783e6cf1724e83b335d012c.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b1b0d9728a562bc9dd216497c1012c97.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_bfdb26c0cf0dfc8063c164eea36d7976.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8ad194dd74e36309418e035d09ff9386.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_0b0e1b926cd304b788752132d1ae7244.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_16e5cf99ddb6b45f2be6f0e387f08935.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8b205bed7eb8b4f02581730e438100df.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_f8e9f702d7ca57ad66754d1499d3be61.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b05e08e9efc7ab81f23d0ccbd64544f4.jpg not downloaded yet
2026-04-27 08:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_389e174ebce743c9cb025a672940210b.jpg not downloaded yet
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NN80859> (referer: https://www.auto1.com/v1/car-details-view/NN80859/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d881f902-457e-52e5-8bfe-50c13e10ee0c with identifier: NN80859
2026-04-27 08:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d881f902-457e-52e5-8bfe-50c13e10ee0c with scrape type 1
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_e1bf9242dcdc7f895593f87f4924e804.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_3090b8e531d05ef7ba928a425664b18a.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_d23f9ddee00c3a911172865d90b892cb.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_c43851c1920e8a635b1cc4282c16a49e.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_0cd8d722373cd1a15b7ae17265e8b933.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_5e462304fea4774d535696f0c598d4c3.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_752455cf4d0dda181faa344fe31b39a0.jpg not downloaded yet
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_389e174ebce743c9cb025a672940210b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_caab86f7e95cb1cf8ccc2dde09fbc35c.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_f1ff2bdc34d4d2a949b1cb7e88d207e0.jpg not downloaded yet
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_817a081a0ba616f5879ddeb9c908968a.jpg not downloaded yet
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5459e50>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_389e174ebce743c9cb025a672940210b.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_752455cf4d0dda181faa344fe31b39a0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba410>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_752455cf4d0dda181faa344fe31b39a0.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_817a081a0ba616f5879ddeb9c908968a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e0d0>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_817a081a0ba616f5879ddeb9c908968a.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL27850/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_f1ff2bdc34d4d2a949b1cb7e88d207e0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551ff10>
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_f1ff2bdc34d4d2a949b1cb7e88d207e0.jpg saved to cache
2026-04-27 08:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_caab86f7e95cb1cf8ccc2dde09fbc35c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_5e462304fea4774d535696f0c598d4c3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57789d0>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_caab86f7e95cb1cf8ccc2dde09fbc35c.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551d0d0>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_5e462304fea4774d535696f0c598d4c3.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_0cd8d722373cd1a15b7ae17265e8b933.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EZ15465> (referer: https://www.auto1.com/v1/car-details-view/EZ15465/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a533d0>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_0cd8d722373cd1a15b7ae17265e8b933.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 723da693-aef3-511f-89fd-7cc57ace8968 with identifier: EZ15465
2026-04-27 08:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723da693-aef3-511f-89fd-7cc57ace8968 with scrape type 1
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_9aea5e3152d6b4f2cf874a93ff4c0976.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_11ff9fdee3377fd5be44549161d113df.jpg not downloaded yet
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_c43851c1920e8a635b1cc4282c16a49e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_24b08faaf1d4fbe5544e1be7cee6eb5f.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_8002f86c9dd7b383b8a2276820c714a4.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_684c8a8bb046dfff1951dd818db82a10.jpg not downloaded yet
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_d23f9ddee00c3a911172865d90b892cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_3728a4c57697270211a449ce2f9f5fb1.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_29138e5f3b0eb3dfe0ab91cb5ae31250.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_0725d182767ed0e85eacaa638a575be5.jpg not downloaded yet
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_36278def72c1f218ff2102355cf1a829.jpg not downloaded yet
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fe150>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_c43851c1920e8a635b1cc4282c16a49e.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_144bcc536f3cd15c473b410f28eebfa7.jpg not downloaded yet
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_8002f86c9dd7b383b8a2276820c714a4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1f10>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_d23f9ddee00c3a911172865d90b892cb.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_11ff9fdee3377fd5be44549161d113df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_36278def72c1f218ff2102355cf1a829.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_144bcc536f3cd15c473b410f28eebfa7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_0725d182767ed0e85eacaa638a575be5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c1610>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_8002f86c9dd7b383b8a2276820c714a4.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a350>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_11ff9fdee3377fd5be44549161d113df.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664fd0>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_36278def72c1f218ff2102355cf1a829.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5a50>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_144bcc536f3cd15c473b410f28eebfa7.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_29138e5f3b0eb3dfe0ab91cb5ae31250.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_3728a4c57697270211a449ce2f9f5fb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5950810>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_0725d182767ed0e85eacaa638a575be5.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_24b08faaf1d4fbe5544e1be7cee6eb5f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594e610>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_29138e5f3b0eb3dfe0ab91cb5ae31250.jpg saved to cache
2026-04-27 08:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e850>
2026-04-27 08:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_3728a4c57697270211a449ce2f9f5fb1.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_9aea5e3152d6b4f2cf874a93ff4c0976.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c210>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_24b08faaf1d4fbe5544e1be7cee6eb5f.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_684c8a8bb046dfff1951dd818db82a10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549a810>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_9aea5e3152d6b4f2cf874a93ff4c0976.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_e1bf9242dcdc7f895593f87f4924e804.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ffd0>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_684c8a8bb046dfff1951dd818db82a10.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 723da693-aef3-511f-89fd-7cc57ace8968
2026-04-27 08:08:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 723da693-aef3-511f-89fd-7cc57ace8968, skipping ID generation
2026-04-27 08:08:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 723da693-aef3-511f-89fd-7cc57ace8968 with scrape type 1
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 723da693-aef3-511f-89fd-7cc57ace8968 sending to next pipeline
2026-04-27 08:08:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 723da693-aef3-511f-89fd-7cc57ace8968, identifier: EZ15465
2026-04-27 08:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 723da693-aef3-511f-89fd-7cc57ace8968 with identifier: EZ15465
2026-04-27 08:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 723da693-aef3-511f-89fd-7cc57ace8968 with identifier: EZ15465
2026-04-27 08:08:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 723da693-aef3-511f-89fd-7cc57ace8968 with identifier: EZ15465 to the API
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_684c8a8bb046dfff1951dd818db82a10.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Capua',
'color': 'gold',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.1L',
'engine_horse_power': 205,
'expiration_date': '2026-04-28T15:11:00Z',
'fuel_type': 'diesel',
'id': '723da693-aef3-511f-89fd-7cc57ace8968',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EZ15465',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Mercedes-Benz',
'model': 'GLC-Klasse',
'odometer': 163278,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91408,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_9aea5e3152d6b4f2cf874a93ff4c0976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87093,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_11ff9fdee3377fd5be44549161d113df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83563,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_24b08faaf1d4fbe5544e1be7cee6eb5f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73687,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_8002f86c9dd7b383b8a2276820c714a4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_684c8a8bb046dfff1951dd818db82a10.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_3728a4c57697270211a449ce2f9f5fb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80810,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_29138e5f3b0eb3dfe0ab91cb5ae31250.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_0725d182767ed0e85eacaa638a575be5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94950,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_36278def72c1f218ff2102355cf1a829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_723da693-aef3-511f-89fd-7cc57ace8968/723da693-aef3-511f-89fd-7cc57ace8968_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76172,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9c/67/9c6789c4f8bb0267c9933ac017437ef3/pa/EZ15465_144bcc536f3cd15c473b410f28eebfa7.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2018-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz GLC-Klasse GLC 250 d 4Matic Executive',
'transmission': 'automatic',
'trim': '4Matic Executive',
'year': 2018}
2026-04-27 08:08:37 [auto1.it] INFO: Saving data for EZ15465: {'created_time': 1777277317.903163, 'last_price_update_time': 1777277317.903176, 'has_photos': True, 'auction_closing_time': 1777389060.0}
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_3090b8e531d05ef7ba928a425664b18a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b05e08e9efc7ab81f23d0ccbd64544f4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c650>
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_e1bf9242dcdc7f895593f87f4924e804.jpg saved to cache
2026-04-27 08:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785050>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_3090b8e531d05ef7ba928a425664b18a.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d881f902-457e-52e5-8bfe-50c13e10ee0c
2026-04-27 08:08:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d881f902-457e-52e5-8bfe-50c13e10ee0c, skipping ID generation
2026-04-27 08:08:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d881f902-457e-52e5-8bfe-50c13e10ee0c with scrape type 1
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d881f902-457e-52e5-8bfe-50c13e10ee0c sending to next pipeline
2026-04-27 08:08:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d881f902-457e-52e5-8bfe-50c13e10ee0c, identifier: NN80859
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596bb10>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b05e08e9efc7ab81f23d0ccbd64544f4.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_f8e9f702d7ca57ad66754d1499d3be61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d881f902-457e-52e5-8bfe-50c13e10ee0c with identifier: NN80859
2026-04-27 08:08:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d881f902-457e-52e5-8bfe-50c13e10ee0c with identifier: NN80859
2026-04-27 08:08:38 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d881f902-457e-52e5-8bfe-50c13e10ee0c with identifier: NN80859 to the API
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_3090b8e531d05ef7ba928a425664b18a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 151,
'category': None,
'city': 'Castelnuovo Del Garda',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:13:15Z',
'fuel_type': 'diesel',
'id': 'd881f902-457e-52e5-8bfe-50c13e10ee0c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4388,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NN80859',
'listing': 'auction',
'location': 'IT, Castelnuovo del Garda (VR)',
'location_confidence': 'geocoded',
'longitude': 10.7598,
'make': 'Jaguar',
'model': 'F-Pace',
'odometer': 69490,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77731,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_e1bf9242dcdc7f895593f87f4924e804.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74176,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_3090b8e531d05ef7ba928a425664b18a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71236,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_d23f9ddee00c3a911172865d90b892cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47680,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_c43851c1920e8a635b1cc4282c16a49e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69001,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_0cd8d722373cd1a15b7ae17265e8b933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_5e462304fea4774d535696f0c598d4c3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_752455cf4d0dda181faa344fe31b39a0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74711,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_caab86f7e95cb1cf8ccc2dde09fbc35c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_f1ff2bdc34d4d2a949b1cb7e88d207e0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d881f902-457e-52e5-8bfe-50c13e10ee0c/d881f902-457e-52e5-8bfe-50c13e10ee0c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62474,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img3c/e2/3ce279be76e1f1e136ee60386cb27d1d/pa/NN80859_817a081a0ba616f5879ddeb9c908968a.jpg',
'Width': 800}],
'postal_code': '37014',
'price': 0,
'price_includes_vat': True,
'province': 'Verona',
'province_code': 'IT-VR',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2020-03-04',
'seats_number': 5,
'seller_name': None,
'title': 'Jaguar F-Pace 20d R-Sport AWD',
'transmission': 'automatic',
'trim': 'R-Sport AWD',
'year': 2020}
2026-04-27 08:08:38 [auto1.it] INFO: Saving data for NN80859: {'created_time': 1777277318.600014, 'last_price_update_time': 1777277318.600027, 'has_photos': True, 'auction_closing_time': 1777389195.0}
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8b205bed7eb8b4f02581730e438100df.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5647bd0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_f8e9f702d7ca57ad66754d1499d3be61.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725e3d0>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8b205bed7eb8b4f02581730e438100df.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_0b0e1b926cd304b788752132d1ae7244.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_16e5cf99ddb6b45f2be6f0e387f08935.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555d510>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_0b0e1b926cd304b788752132d1ae7244.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c290>
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_16e5cf99ddb6b45f2be6f0e387f08935.jpg saved to cache
2026-04-27 08:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8ad194dd74e36309418e035d09ff9386.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_bfdb26c0cf0dfc8063c164eea36d7976.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_9814a404a783e6cf1724e83b335d012c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba410>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8ad194dd74e36309418e035d09ff9386.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab8650>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_bfdb26c0cf0dfc8063c164eea36d7976.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1e50>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_9814a404a783e6cf1724e83b335d012c.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b1b0d9728a562bc9dd216497c1012c97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57869d0>
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b1b0d9728a562bc9dd216497c1012c97.jpg saved to cache
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f327384d-87a8-5193-85c9-99af3374f455
2026-04-27 08:08:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f327384d-87a8-5193-85c9-99af3374f455, skipping ID generation
2026-04-27 08:08:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f327384d-87a8-5193-85c9-99af3374f455 with scrape type 1
2026-04-27 08:08:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f327384d-87a8-5193-85c9-99af3374f455 sending to next pipeline
2026-04-27 08:08:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f327384d-87a8-5193-85c9-99af3374f455, identifier: CV66158
2026-04-27 08:08:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f327384d-87a8-5193-85c9-99af3374f455 with identifier: CV66158
2026-04-27 08:08:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f327384d-87a8-5193-85c9-99af3374f455 with identifier: CV66158
2026-04-27 08:08:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f327384d-87a8-5193-85c9-99af3374f455 with identifier: CV66158 to the API
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b1b0d9728a562bc9dd216497c1012c97.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Reggio Emilia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.2L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:09:27Z',
'fuel_type': 'diesel',
'id': 'f327384d-87a8-5193-85c9-99af3374f455',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CV66158',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Mazda',
'model': 'CX-5',
'odometer': 154745,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_9814a404a783e6cf1724e83b335d012c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61727,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b1b0d9728a562bc9dd216497c1012c97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62361,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_bfdb26c0cf0dfc8063c164eea36d7976.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8ad194dd74e36309418e035d09ff9386.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48741,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_0b0e1b926cd304b788752132d1ae7244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58346,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_16e5cf99ddb6b45f2be6f0e387f08935.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51080,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_8b205bed7eb8b4f02581730e438100df.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64991,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_f8e9f702d7ca57ad66754d1499d3be61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66273,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_b05e08e9efc7ab81f23d0ccbd64544f4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f327384d-87a8-5193-85c9-99af3374f455/f327384d-87a8-5193-85c9-99af3374f455_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img59/ce/59ce67b0f3481345582db6f4dee9e8c8/pa/CV66158_389e174ebce743c9cb025a672940210b.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2016-09-14',
'seats_number': 5,
'seller_name': None,
'title': 'Mazda CX-5 2.2 Turbodiesel Evolve 4WD',
'transmission': 'automatic',
'trim': 'Evolve 4WD',
'year': 2016}
2026-04-27 08:08:39 [auto1.it] INFO: Saving data for CV66158: {'created_time': 1777277319.770931, 'last_price_update_time': 1777277319.770941, 'has_photos': True, 'auction_closing_time': 1777388967.0}
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 264.667(s), this was the 2nd time calling it.
2026-04-27 08:08:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.381449806701644 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:08:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SD72417> (referer: https://www.auto1.com/v1/car-details-view/SD72417/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with identifier: SD72417
2026-04-27 08:08:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with scrape type 1
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_56f269f6655de09f23398617a8506eb2.jpg not downloaded yet
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_101fdbedd793b18224a67669751231cb.jpg not downloaded yet
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_3cf0b466b396aed886ef5a0c51a75e11.jpg not downloaded yet
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_eea8ceb7e56b925f99a2b4e81b4ff1f3.jpg not downloaded yet
2026-04-27 08:08:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_e775c38220ab57f1f234650f77b71697.jpg not downloaded yet
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LP60965/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_e775c38220ab57f1f234650f77b71697.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_eea8ceb7e56b925f99a2b4e81b4ff1f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564d750>
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:45 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_e775c38220ab57f1f234650f77b71697.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547c610>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_eea8ceb7e56b925f99a2b4e81b4ff1f3.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BR14904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_3cf0b466b396aed886ef5a0c51a75e11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_101fdbedd793b18224a67669751231cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5481390>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_3cf0b466b396aed886ef5a0c51a75e11.jpg saved to cache
2026-04-27 08:08:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c2310>
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_101fdbedd793b18224a67669751231cb.jpg saved to cache
2026-04-27 08:08:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH97185/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_56f269f6655de09f23398617a8506eb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c7010>
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_56f269f6655de09f23398617a8506eb2.jpg saved to cache
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760
2026-04-27 08:08:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d60480a3-90f7-5bd8-800c-5aaa9dbdd760, skipping ID generation
2026-04-27 08:08:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with scrape type 1
2026-04-27 08:08:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d60480a3-90f7-5bd8-800c-5aaa9dbdd760 sending to next pipeline
2026-04-27 08:08:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d60480a3-90f7-5bd8-800c-5aaa9dbdd760, identifier: SD72417
2026-04-27 08:08:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with identifier: SD72417
2026-04-27 08:08:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with identifier: SD72417
2026-04-27 08:08:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:08:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d60480a3-90f7-5bd8-800c-5aaa9dbdd760 with identifier: SD72417 to the API
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:08:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:08:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_56f269f6655de09f23398617a8506eb2.jpg>
{'auction_title': '',
'c_o_2_emission_value': 143,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 4',
'engine': '1.9L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:14:05Z',
'fuel_type': 'diesel',
'id': 'd60480a3-90f7-5bd8-800c-5aaa9dbdd760',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SD72417',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volkswagen',
'model': 'New Beetle',
'odometer': 241805,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_56f269f6655de09f23398617a8506eb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60802,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_101fdbedd793b18224a67669751231cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60353,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_3cf0b466b396aed886ef5a0c51a75e11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63666,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_eea8ceb7e56b925f99a2b4e81b4ff1f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d60480a3-90f7-5bd8-800c-5aaa9dbdd760/d60480a3-90f7-5bd8-800c-5aaa9dbdd760_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59462,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/20/b320bbf89cf8b30dc44b17b5817b94ad/pa/SD72417_e775c38220ab57f1f234650f77b71697.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2010-06-28',
'seats_number': 4,
'seller_name': None,
'title': 'Volkswagen New Beetle 1.9 TDI',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-04-27 08:08:49 [auto1.it] INFO: Saving data for SD72417: {'created_time': 1777277329.527984, 'last_price_update_time': 1777277329.527995, 'has_photos': True, 'auction_closing_time': 1777389245.0}
2026-04-27 08:08:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 3rd time calling it.
2026-04-27 08:08:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SS01622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JH44016/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YL89014/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL27850> (referer: https://www.auto1.com/v1/car-details-view/FL27850/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with identifier: FL27850
2026-04-27 08:08:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with scrape type 1
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_61b66d771d78ef9c8543ae70f12f6948.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_a7eb5e67edd6b89882ec42b35f590d87.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_0f43c3ba2ee45abadbed03e042ba80e6.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_8c8b5a4d48911b0690d05307d988be19.jpg not downloaded yet
2026-04-27 08:08:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_22040a07d312c419889a7f50818843ea.jpg not downloaded yet
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AA32555/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_22040a07d312c419889a7f50818843ea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563e610>
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_22040a07d312c419889a7f50818843ea.jpg saved to cache
2026-04-27 08:08:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PW70389/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:08:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_8c8b5a4d48911b0690d05307d988be19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a2490>
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_8c8b5a4d48911b0690d05307d988be19.jpg saved to cache
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:08:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_0f43c3ba2ee45abadbed03e042ba80e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b2d90>
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:08:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:08:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_0f43c3ba2ee45abadbed03e042ba80e6.jpg saved to cache
2026-04-27 08:08:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NJ15500/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_a7eb5e67edd6b89882ec42b35f590d87.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_61b66d771d78ef9c8543ae70f12f6948.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725ebd0>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_a7eb5e67edd6b89882ec42b35f590d87.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555eb90>
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_61b66d771d78ef9c8543ae70f12f6948.jpg saved to cache
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6
2026-04-27 08:09:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9c1848a9-8867-5aba-8e54-7deaa66a95e6, skipping ID generation
2026-04-27 08:09:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with scrape type 1
2026-04-27 08:09:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9c1848a9-8867-5aba-8e54-7deaa66a95e6 sending to next pipeline
2026-04-27 08:09:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9c1848a9-8867-5aba-8e54-7deaa66a95e6, identifier: FL27850
2026-04-27 08:09:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with identifier: FL27850
2026-04-27 08:09:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with identifier: FL27850
2026-04-27 08:09:01 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9c1848a9-8867-5aba-8e54-7deaa66a95e6 with identifier: FL27850 to the API
2026-04-27 08:09:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:02 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_61b66d771d78ef9c8543ae70f12f6948.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Settimo Torinese',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.3L',
'engine_horse_power': 102,
'expiration_date': '2026-04-28T15:53:57Z',
'fuel_type': 'hybrid',
'id': '9c1848a9-8867-5aba-8e54-7deaa66a95e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL27850',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Honda',
'model': 'Insight',
'odometer': 256830,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_61b66d771d78ef9c8543ae70f12f6948.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58135,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_a7eb5e67edd6b89882ec42b35f590d87.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_0f43c3ba2ee45abadbed03e042ba80e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70294,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_8c8b5a4d48911b0690d05307d988be19.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9c1848a9-8867-5aba-8e54-7deaa66a95e6/9c1848a9-8867-5aba-8e54-7deaa66a95e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img14/23/1423257f2cb461f2b3b0fb3a16a2ddac/pa/FL27850_22040a07d312c419889a7f50818843ea.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2011-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Honda Insight 1.3 Hybrid Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2011}
2026-04-27 08:09:02 [auto1.it] INFO: Saving data for FL27850: {'created_time': 1777277342.650196, 'last_price_update_time': 1777277342.650207, 'has_photos': True, 'auction_closing_time': 1777391637.0}
2026-04-27 08:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BR14904> (referer: https://www.auto1.com/v1/car-details-view/BR14904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fce9d385-c44e-55c1-a4e6-2d2c5b03815d with identifier: BR14904
2026-04-27 08:09:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d with scrape type 1
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_528b7e9767b92acf0016f427a9db1cac.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_bc73114df0d0c8b1b560a55b8f30c4dc.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_7439e27102e77036d434c21205e07eb7.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_613823d2601f9f35bf4008ca22e121e1.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_a8b47d04dd25c17618b39e1855aeb9cb.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6d128e51b1b360bc879c50f035f956d9.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_86de076b3aaf018643feafbb16c3162e.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_58f91cf0abcba882c8bf2f623d910a8d.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6bb102846d360d36c8645c1cfe68f85b.jpg not downloaded yet
2026-04-27 08:09:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_f593db6dc3ee8a0a34f7eb334c43fae7.jpg not downloaded yet
2026-04-27 08:09:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LP60965> (referer: https://www.auto1.com/v1/car-details-view/LP60965/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_f593db6dc3ee8a0a34f7eb334c43fae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-04-27 08:09:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a with scrape type 1
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_3620aaaced5d5633a1f59cb18ae36ab7.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b115e54238e0eea4db21c76dedc1f2d7.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_f0ee4962059bbf1b0700da3670219475.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_1cbdc98a69a1a5f218d4f67858e82092.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_358ac4537eb369d9295e97be2af33f7d.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_2477853b72396d1ad6c8288594dd0fee.jpg not downloaded yet
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550c850>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_f593db6dc3ee8a0a34f7eb334c43fae7.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_cf8c4933068ac415c569ffe5eed9d99a.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b6ba48d8e4bdc22e2104029ce0016e86.jpg not downloaded yet
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_0fe5080ef20d36b4500a148ba515998b.jpg not downloaded yet
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6bb102846d360d36c8645c1cfe68f85b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_44696ac319e328aa09ecbc9a42ee4e03.jpg not downloaded yet
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559e410>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6bb102846d360d36c8645c1cfe68f85b.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_0fe5080ef20d36b4500a148ba515998b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a24b90>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_0fe5080ef20d36b4500a148ba515998b.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_44696ac319e328aa09ecbc9a42ee4e03.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e7e50>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_44696ac319e328aa09ecbc9a42ee4e03.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b6ba48d8e4bdc22e2104029ce0016e86.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50850>
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b6ba48d8e4bdc22e2104029ce0016e86.jpg saved to cache
2026-04-27 08:09:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_cf8c4933068ac415c569ffe5eed9d99a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5837650>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_cf8c4933068ac415c569ffe5eed9d99a.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_2477853b72396d1ad6c8288594dd0fee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a51350>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_2477853b72396d1ad6c8288594dd0fee.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_358ac4537eb369d9295e97be2af33f7d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_1cbdc98a69a1a5f218d4f67858e82092.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1090>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_358ac4537eb369d9295e97be2af33f7d.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_f0ee4962059bbf1b0700da3670219475.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25810>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_1cbdc98a69a1a5f218d4f67858e82092.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555d650>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_f0ee4962059bbf1b0700da3670219475.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b115e54238e0eea4db21c76dedc1f2d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_3620aaaced5d5633a1f59cb18ae36ab7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_58f91cf0abcba882c8bf2f623d910a8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25f50>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b115e54238e0eea4db21c76dedc1f2d7.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab91d0>
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_3620aaaced5d5633a1f59cb18ae36ab7.jpg saved to cache
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a
2026-04-27 08:09:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab9fe14e-e6e2-56e8-b104-792b2bcec07a, skipping ID generation
2026-04-27 08:09:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a with scrape type 1
2026-04-27 08:09:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab9fe14e-e6e2-56e8-b104-792b2bcec07a sending to next pipeline
2026-04-27 08:09:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ab9fe14e-e6e2-56e8-b104-792b2bcec07a, identifier: LP60965
2026-04-27 08:09:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-04-27 08:09:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965
2026-04-27 08:09:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ab9fe14e-e6e2-56e8-b104-792b2bcec07a with identifier: LP60965 to the API
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_3620aaaced5d5633a1f59cb18ae36ab7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 207,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.8L',
'engine_horse_power': 178,
'expiration_date': '2026-04-28T15:35:58Z',
'fuel_type': 'diesel',
'id': 'ab9fe14e-e6e2-56e8-b104-792b2bcec07a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LP60965',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Lancia',
'model': 'Voyager',
'odometer': 149042,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67494,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_3620aaaced5d5633a1f59cb18ae36ab7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b115e54238e0eea4db21c76dedc1f2d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65297,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_f0ee4962059bbf1b0700da3670219475.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52117,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_1cbdc98a69a1a5f218d4f67858e82092.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54193,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_358ac4537eb369d9295e97be2af33f7d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_2477853b72396d1ad6c8288594dd0fee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_cf8c4933068ac415c569ffe5eed9d99a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71084,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_b6ba48d8e4bdc22e2104029ce0016e86.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67661,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_0fe5080ef20d36b4500a148ba515998b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ab9fe14e-e6e2-56e8-b104-792b2bcec07a/ab9fe14e-e6e2-56e8-b104-792b2bcec07a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55989,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img6b/3e/6b3e98039cb39c71413daa31c67e77c2/pa/LP60965_44696ac319e328aa09ecbc9a42ee4e03.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2014-10-30',
'seats_number': 7,
'seller_name': None,
'title': 'Lancia Voyager 2.8 JTDM S',
'transmission': 'automatic',
'trim': 'S',
'year': 2014}
2026-04-27 08:09:07 [auto1.it] INFO: Saving data for LP60965: {'created_time': 1777277347.011959, 'last_price_update_time': 1777277347.011971, 'has_photos': True, 'auction_closing_time': 1777390558.0}
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_86de076b3aaf018643feafbb16c3162e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a3990>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_58f91cf0abcba882c8bf2f623d910a8d.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c4a50>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_86de076b3aaf018643feafbb16c3162e.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6d128e51b1b360bc879c50f035f956d9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649ce50>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6d128e51b1b360bc879c50f035f956d9.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_a8b47d04dd25c17618b39e1855aeb9cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_613823d2601f9f35bf4008ca22e121e1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550e790>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_a8b47d04dd25c17618b39e1855aeb9cb.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1550>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_613823d2601f9f35bf4008ca22e121e1.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_7439e27102e77036d434c21205e07eb7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_bc73114df0d0c8b1b560a55b8f30c4dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_528b7e9767b92acf0016f427a9db1cac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555d390>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_7439e27102e77036d434c21205e07eb7.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763910>
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_bc73114df0d0c8b1b560a55b8f30c4dc.jpg saved to cache
2026-04-27 08:09:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5abaf10>
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_528b7e9767b92acf0016f427a9db1cac.jpg saved to cache
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d
2026-04-27 08:09:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fce9d385-c44e-55c1-a4e6-2d2c5b03815d, skipping ID generation
2026-04-27 08:09:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d with scrape type 1
2026-04-27 08:09:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fce9d385-c44e-55c1-a4e6-2d2c5b03815d sending to next pipeline
2026-04-27 08:09:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fce9d385-c44e-55c1-a4e6-2d2c5b03815d, identifier: BR14904
2026-04-27 08:09:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fce9d385-c44e-55c1-a4e6-2d2c5b03815d with identifier: BR14904
2026-04-27 08:09:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fce9d385-c44e-55c1-a4e6-2d2c5b03815d with identifier: BR14904
2026-04-27 08:09:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fce9d385-c44e-55c1-a4e6-2d2c5b03815d with identifier: BR14904 to the API
2026-04-27 08:09:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_528b7e9767b92acf0016f427a9db1cac.jpg>
{'auction_title': '',
'c_o_2_emission_value': 145,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:11:54Z',
'fuel_type': 'petrol',
'id': 'fce9d385-c44e-55c1-a4e6-2d2c5b03815d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BR14904',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Volkswagen',
'model': 'T-Roc',
'odometer': 42954,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94546,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_528b7e9767b92acf0016f427a9db1cac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_bc73114df0d0c8b1b560a55b8f30c4dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_7439e27102e77036d434c21205e07eb7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84370,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_613823d2601f9f35bf4008ca22e121e1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_a8b47d04dd25c17618b39e1855aeb9cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93642,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6d128e51b1b360bc879c50f035f956d9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78536,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_86de076b3aaf018643feafbb16c3162e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_58f91cf0abcba882c8bf2f623d910a8d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_6bb102846d360d36c8645c1cfe68f85b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fce9d385-c44e-55c1-a4e6-2d2c5b03815d/fce9d385-c44e-55c1-a4e6-2d2c5b03815d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63145,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgad/91/ad9198dcc13925f711db61cad3aa3098/pa/BR14904_f593db6dc3ee8a0a34f7eb334c43fae7.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2023-12-27',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen T-Roc 1.5 TSI ACT R-Line',
'transmission': 'automatic',
'trim': 'R-Line',
'year': 2023}
2026-04-27 08:09:09 [auto1.it] INFO: Saving data for BR14904: {'created_time': 1777277349.464698, 'last_price_update_time': 1777277349.464708, 'has_photos': True, 'auction_closing_time': 1777389114.0}
2026-04-27 08:09:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JN62828/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:10 [scrapy.extensions.logstats] INFO: Crawled 574 pages (at 23 pages/min), scraped 246 items (at 12 items/min)
2026-04-27 08:09:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:09:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SS01622> (referer: https://www.auto1.com/v1/car-details-view/SS01622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 with identifier: SS01622
2026-04-27 08:09:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 with scrape type 1
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_a7075acf8ac8a7876682699d9cac4cd6.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_2ffa4b9e6e0b1cfdc28a3924d84c8294.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_58f6a4d663b79252b2543bd6df77673d.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_7bfe8cc6641cba3ef989805c62eaf645.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_d2bc41ccfe9db5b9e5a60b33003432b5.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_806ffcfcfd970832c92110a592ad10a5.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_3543894a651e29d5a2a444da568b62fd.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_e274b243bcf778539aa15dc2f7a81ff3.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_919dc1e54811642b41f6d2bfb8f8d899.jpg not downloaded yet
2026-04-27 08:09:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_73bf226065c9cf41c26b3d76ccd26b6d.jpg not downloaded yet
2026-04-27 08:09:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH44016> (referer: https://www.auto1.com/v1/car-details-view/JH44016/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc3f061f-5440-5cb2-a6c7-ea25206413b5 with identifier: JH44016
2026-04-27 08:09:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3f061f-5440-5cb2-a6c7-ea25206413b5 with scrape type 1
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_e021cab8486cf6057b6e9cb8b8f393d6.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_d953e5b2646e4095a6890e8d08cb6705.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_4c3ba63a82fb262ce920ef03a39e0649.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_1a170d2b208f8443b9718e6ce7f6bdf2.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_48e082ff707969a4452b169e533dfebb.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_9c4711988d08c9b8255335d3037bbc48.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_58e5666f4c973bb931bd364aaef122c9.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a686f3c44b3c6c9541264633f552e440.jpg not downloaded yet
2026-04-27 08:09:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a008b96a0a7f28bbcfeb01ebc440d4f5.jpg not downloaded yet
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_521d1681e67dc2df8eb684b2d180c37b.jpg not downloaded yet
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_73bf226065c9cf41c26b3d76ccd26b6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af350>
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_73bf226065c9cf41c26b3d76ccd26b6d.jpg saved to cache
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_521d1681e67dc2df8eb684b2d180c37b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a008b96a0a7f28bbcfeb01ebc440d4f5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667a50>
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_521d1681e67dc2df8eb684b2d180c37b.jpg saved to cache
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c3d0>
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a008b96a0a7f28bbcfeb01ebc440d4f5.jpg saved to cache
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a686f3c44b3c6c9541264633f552e440.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665910>
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a686f3c44b3c6c9541264633f552e440.jpg saved to cache
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_58e5666f4c973bb931bd364aaef122c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550e510>
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_58e5666f4c973bb931bd364aaef122c9.jpg saved to cache
2026-04-27 08:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_9c4711988d08c9b8255335d3037bbc48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551c390>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_9c4711988d08c9b8255335d3037bbc48.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_48e082ff707969a4452b169e533dfebb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a0450>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_48e082ff707969a4452b169e533dfebb.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_1a170d2b208f8443b9718e6ce7f6bdf2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6590>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_1a170d2b208f8443b9718e6ce7f6bdf2.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_4c3ba63a82fb262ce920ef03a39e0649.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a3210>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_4c3ba63a82fb262ce920ef03a39e0649.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_d953e5b2646e4095a6890e8d08cb6705.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_e021cab8486cf6057b6e9cb8b8f393d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YL89014> (referer: https://www.auto1.com/v1/car-details-view/YL89014/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649cad0>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_d953e5b2646e4095a6890e8d08cb6705.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c1450>
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_e021cab8486cf6057b6e9cb8b8f393d6.jpg saved to cache
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fc3f061f-5440-5cb2-a6c7-ea25206413b5
2026-04-27 08:09:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fc3f061f-5440-5cb2-a6c7-ea25206413b5, skipping ID generation
2026-04-27 08:09:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc3f061f-5440-5cb2-a6c7-ea25206413b5 with scrape type 1
2026-04-27 08:09:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fc3f061f-5440-5cb2-a6c7-ea25206413b5 sending to next pipeline
2026-04-27 08:09:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fc3f061f-5440-5cb2-a6c7-ea25206413b5, identifier: JH44016
2026-04-27 08:09:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fc3f061f-5440-5cb2-a6c7-ea25206413b5 with identifier: JH44016
2026-04-27 08:09:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fc3f061f-5440-5cb2-a6c7-ea25206413b5 with identifier: JH44016
2026-04-27 08:09:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fc3f061f-5440-5cb2-a6c7-ea25206413b5 with identifier: JH44016 to the API
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_e021cab8486cf6057b6e9cb8b8f393d6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'category': None,
'city': 'Padova',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:00:31Z',
'fuel_type': 'diesel',
'id': 'fc3f061f-5440-5cb2-a6c7-ea25206413b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH44016',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'BMW',
'model': '1er',
'odometer': 256811,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_e021cab8486cf6057b6e9cb8b8f393d6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61468,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_d953e5b2646e4095a6890e8d08cb6705.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60877,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_4c3ba63a82fb262ce920ef03a39e0649.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49998,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_1a170d2b208f8443b9718e6ce7f6bdf2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_48e082ff707969a4452b169e533dfebb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60872,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_9c4711988d08c9b8255335d3037bbc48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58600,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_58e5666f4c973bb931bd364aaef122c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66425,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a686f3c44b3c6c9541264633f552e440.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63219,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_a008b96a0a7f28bbcfeb01ebc440d4f5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fc3f061f-5440-5cb2-a6c7-ea25206413b5/fc3f061f-5440-5cb2-a6c7-ea25206413b5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56855,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9b/be/9bbe13f2c0e827ba4fab01731f66346b/pa/JH44016_521d1681e67dc2df8eb684b2d180c37b.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2012-05-30',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 118d',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-04-27 08:09:19 [auto1.it] INFO: Saving data for JH44016: {'created_time': 1777277359.364615, 'last_price_update_time': 1777277359.364627, 'has_photos': True, 'auction_closing_time': 1777388431.0}
2026-04-27 08:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_919dc1e54811642b41f6d2bfb8f8d899.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-04-27 08:09:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with scrape type 1
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_52dfb72fb55004e3da6f2ccbbd36496b.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_346f362533aff01e598bda54028ba286.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_c8af28eb674991a27313f46b4e61e83f.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_048c0a8379e3d8acf96e94bd682d4ac9.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_285ce025126ba78e013f50cc1b29493f.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_8f179c24d7a24f4b95e35bde769505b3.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_701d65b818e46cefb467fa3a80ad0a8c.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_341945130fa31fc7f415c2b59525f2a1.jpg not downloaded yet
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6485450>
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_919dc1e54811642b41f6d2bfb8f8d899.jpg saved to cache
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_990ccfe5c17049ab196e0f989f9fee4b.jpg not downloaded yet
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_be673ee5d1297f834a746b14eec0eaef.jpg not downloaded yet
2026-04-27 08:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_e274b243bcf778539aa15dc2f7a81ff3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_3543894a651e29d5a2a444da568b62fd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c0dd0>
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_e274b243bcf778539aa15dc2f7a81ff3.jpg saved to cache
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a2d90>
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_3543894a651e29d5a2a444da568b62fd.jpg saved to cache
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_be673ee5d1297f834a746b14eec0eaef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_990ccfe5c17049ab196e0f989f9fee4b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5339850>
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_be673ee5d1297f834a746b14eec0eaef.jpg saved to cache
2026-04-27 08:09:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769310>
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_990ccfe5c17049ab196e0f989f9fee4b.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_341945130fa31fc7f415c2b59525f2a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_701d65b818e46cefb467fa3a80ad0a8c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6090>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_341945130fa31fc7f415c2b59525f2a1.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c4190>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_701d65b818e46cefb467fa3a80ad0a8c.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_285ce025126ba78e013f50cc1b29493f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_8f179c24d7a24f4b95e35bde769505b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564ef10>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_285ce025126ba78e013f50cc1b29493f.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AA32555> (referer: https://www.auto1.com/v1/car-details-view/AA32555/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5763e90>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_8f179c24d7a24f4b95e35bde769505b3.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_048c0a8379e3d8acf96e94bd682d4ac9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff9bf700-814c-51c3-9101-3ad1ea796645 with identifier: AA32555
2026-04-27 08:09:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff9bf700-814c-51c3-9101-3ad1ea796645 with scrape type 1
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_125f001e8719b3f5bfdcdb1aba682420.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_34d2e9e6d77ae2a185801bc66f6c4614.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dd34e67341cd1003c3de2e7a1383c0f0.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_057635dd19142acffcaf678fa25b81ab.jpg not downloaded yet
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_52dfb72fb55004e3da6f2ccbbd36496b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_66690a57ca561e47e25e2b6165f06a1d.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dbe3b01751d5dd45c71e64e3efd056f7.jpg not downloaded yet
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_c8af28eb674991a27313f46b4e61e83f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_ac50cae48e95a094079a0029b53e2ca0.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_0e478b3c04eda4eee4989b10888a38c4.jpg not downloaded yet
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad890>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_048c0a8379e3d8acf96e94bd682d4ac9.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_52051ad7ce4e57a4d9b100f495eb6ec9.jpg not downloaded yet
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_3f1308ae05e7bc8184407e41654623b8.jpg not downloaded yet
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c2050>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_52dfb72fb55004e3da6f2ccbbd36496b.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564f350>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_c8af28eb674991a27313f46b4e61e83f.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_057635dd19142acffcaf678fa25b81ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dbe3b01751d5dd45c71e64e3efd056f7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_52051ad7ce4e57a4d9b100f495eb6ec9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567fe50>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_057635dd19142acffcaf678fa25b81ab.jpg saved to cache
2026-04-27 08:09:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5559bd0>
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dbe3b01751d5dd45c71e64e3efd056f7.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_3f1308ae05e7bc8184407e41654623b8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6580a90>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_52051ad7ce4e57a4d9b100f495eb6ec9.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577a5d0>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_3f1308ae05e7bc8184407e41654623b8.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_0e478b3c04eda4eee4989b10888a38c4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_66690a57ca561e47e25e2b6165f06a1d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_ac50cae48e95a094079a0029b53e2ca0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ec90>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_0e478b3c04eda4eee4989b10888a38c4.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594d510>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_66690a57ca561e47e25e2b6165f06a1d.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555f210>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_ac50cae48e95a094079a0029b53e2ca0.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_34d2e9e6d77ae2a185801bc66f6c4614.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_125f001e8719b3f5bfdcdb1aba682420.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dd34e67341cd1003c3de2e7a1383c0f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57634d0>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_34d2e9e6d77ae2a185801bc66f6c4614.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555f250>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_125f001e8719b3f5bfdcdb1aba682420.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817c10>
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dd34e67341cd1003c3de2e7a1383c0f0.jpg saved to cache
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff9bf700-814c-51c3-9101-3ad1ea796645
2026-04-27 08:09:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff9bf700-814c-51c3-9101-3ad1ea796645, skipping ID generation
2026-04-27 08:09:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff9bf700-814c-51c3-9101-3ad1ea796645 with scrape type 1
2026-04-27 08:09:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff9bf700-814c-51c3-9101-3ad1ea796645 sending to next pipeline
2026-04-27 08:09:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ff9bf700-814c-51c3-9101-3ad1ea796645, identifier: AA32555
2026-04-27 08:09:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ff9bf700-814c-51c3-9101-3ad1ea796645 with identifier: AA32555
2026-04-27 08:09:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ff9bf700-814c-51c3-9101-3ad1ea796645 with identifier: AA32555
2026-04-27 08:09:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ff9bf700-814c-51c3-9101-3ad1ea796645 with identifier: AA32555 to the API
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dd34e67341cd1003c3de2e7a1383c0f0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 97,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:34:11Z',
'fuel_type': 'diesel',
'id': 'ff9bf700-814c-51c3-9101-3ad1ea796645',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AA32555',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'BMW',
'model': '1er',
'odometer': 314167,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65885,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_125f001e8719b3f5bfdcdb1aba682420.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_34d2e9e6d77ae2a185801bc66f6c4614.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58507,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dd34e67341cd1003c3de2e7a1383c0f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68537,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_057635dd19142acffcaf678fa25b81ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54583,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_66690a57ca561e47e25e2b6165f06a1d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59249,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_dbe3b01751d5dd45c71e64e3efd056f7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74771,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_ac50cae48e95a094079a0029b53e2ca0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99257,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_0e478b3c04eda4eee4989b10888a38c4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_52051ad7ce4e57a4d9b100f495eb6ec9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ff9bf700-814c-51c3-9101-3ad1ea796645/ff9bf700-814c-51c3-9101-3ad1ea796645_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf6/68/f668799f313d35140d2ab5f6415696d0/pa/AA32555_3f1308ae05e7bc8184407e41654623b8.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2015-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'BMW 1er 116d Advantage',
'transmission': 'manual',
'trim': 'Advantage',
'year': 2015}
2026-04-27 08:09:22 [auto1.it] INFO: Saving data for AA32555: {'created_time': 1777277362.249573, 'last_price_update_time': 1777277362.249584, 'has_photos': True, 'auction_closing_time': 1777390451.0}
2026-04-27 08:09:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-04-27 08:09:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014
2026-04-27 08:09:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 with identifier: YL89014 to the API
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:22 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 90,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.5L',
'engine_horse_power': 75,
'expiration_date': '2026-04-28T15:23:56Z',
'fuel_type': 'diesel',
'id': '40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YL89014',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Dacia',
'model': 'Sandero',
'odometer': 143777,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_52dfb72fb55004e3da6f2ccbbd36496b.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_346f362533aff01e598bda54028ba286.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_c8af28eb674991a27313f46b4e61e83f.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_048c0a8379e3d8acf96e94bd682d4ac9.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_285ce025126ba78e013f50cc1b29493f.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_8f179c24d7a24f4b95e35bde769505b3.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_701d65b818e46cefb467fa3a80ad0a8c.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_341945130fa31fc7f415c2b59525f2a1.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_990ccfe5c17049ab196e0f989f9fee4b.jpg',
'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_be673ee5d1297f834a746b14eec0eaef.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122882,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_52dfb72fb55004e3da6f2ccbbd36496b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113776,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_c8af28eb674991a27313f46b4e61e83f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_048c0a8379e3d8acf96e94bd682d4ac9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94848,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_285ce025126ba78e013f50cc1b29493f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111717,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_8f179c24d7a24f4b95e35bde769505b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93978,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_701d65b818e46cefb467fa3a80ad0a8c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_341945130fa31fc7f415c2b59525f2a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_990ccfe5c17049ab196e0f989f9fee4b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1/40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img31/53/31530b0e61cf86587714b60f0fb486b9/pa/YL89014_be673ee5d1297f834a746b14eec0eaef.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2016-05-23',
'seats_number': 5,
'seller_name': None,
'title': 'Dacia Sandero 1.5 dCi La Gazzetta dello Sport',
'transmission': 'manual',
'trim': 'La Gazzetta dello Sport',
'year': 2016}
2026-04-27 08:09:22 [auto1.it] INFO: Saving data for YL89014: {'created_time': 1777277362.576565, 'last_price_update_time': 1777277362.576575, 'has_photos': True, 'auction_closing_time': 1777389836.0}
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_806ffcfcfd970832c92110a592ad10a5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 40ca76cf-49b4-5f04-a85b-e7fa8ba87fd1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_d2bc41ccfe9db5b9e5a60b33003432b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551c710>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_806ffcfcfd970832c92110a592ad10a5.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545ab10>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_d2bc41ccfe9db5b9e5a60b33003432b5.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_58f6a4d663b79252b2543bd6df77673d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5778a50>
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_58f6a4d663b79252b2543bd6df77673d.jpg saved to cache
2026-04-27 08:09:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_a7075acf8ac8a7876682699d9cac4cd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f5c50>
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_a7075acf8ac8a7876682699d9cac4cd6.jpg saved to cache
2026-04-27 08:09:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6
2026-04-27 08:09:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 with identifier: SS01622
2026-04-27 08:09:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 with identifier: SS01622
2026-04-27 08:09:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 with identifier: SS01622 to the API
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:24 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 169,
'category': None,
'city': None,
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:31:50Z',
'fuel_type': 'diesel',
'id': 'cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS01622',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 303564,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_a7075acf8ac8a7876682699d9cac4cd6.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_2ffa4b9e6e0b1cfdc28a3924d84c8294.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_58f6a4d663b79252b2543bd6df77673d.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_7bfe8cc6641cba3ef989805c62eaf645.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_d2bc41ccfe9db5b9e5a60b33003432b5.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_806ffcfcfd970832c92110a592ad10a5.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_3543894a651e29d5a2a444da568b62fd.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_e274b243bcf778539aa15dc2f7a81ff3.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_919dc1e54811642b41f6d2bfb8f8d899.jpg',
'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_73bf226065c9cf41c26b3d76ccd26b6d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4389758,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_a7075acf8ac8a7876682699d9cac4cd6.jpg',
'Width': 3923},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123223,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_58f6a4d663b79252b2543bd6df77673d.jpg',
'Width': 763},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3710712,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_d2bc41ccfe9db5b9e5a60b33003432b5.jpg',
'Width': 3593},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132696,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_806ffcfcfd970832c92110a592ad10a5.jpg',
'Width': 785},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96863,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_3543894a651e29d5a2a444da568b62fd.jpg',
'Width': 684},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3854688,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_e274b243bcf778539aa15dc2f7a81ff3.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_919dc1e54811642b41f6d2bfb8f8d899.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6/cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3575685,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/imgd1/6f/d16fac5c9ce1d7184720d1505c71337f/pa/SS01622_73bf226065c9cf41c26b3d76ccd26b6d.jpg',
'Width': 4032}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2011-08-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2011}
2026-04-27 08:09:24 [auto1.it] INFO: Saving data for SS01622: {'created_time': 1777277364.055468, 'last_price_update_time': 1777277364.055478, 'has_photos': True, 'auction_closing_time': 1777390310.0}
2026-04-27 08:09:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item cf6f0ea8-0d8c-5bdd-85cf-2ca2cb7e50e6 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GZ99467> (referer: https://www.auto1.com/v1/car-details-view/GZ99467/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with identifier: GZ99467
2026-04-27 08:09:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with scrape type 1
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_ca1afa72fd44dd969f4320956035cb11.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_f88ba7c7f8cb892c26fdd8414c4fb956.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6222ace34af51fa2d936fdea08ca129d.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_bee2619eefd4d0115d0a72123fe4c294.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_c0f33a52897a0f1936aaa8e970fe70ef.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_fa753b2b89b9635c27d2a44a3f5bd86d.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_1a61a1e0236b7c06ed0d9e673f96db77.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_4b0a4c4c3755d3548f7bf4ca9e149f7a.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_415cc8c51c00b091ff7b55cd625bcc0b.jpg not downloaded yet
2026-04-27 08:09:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6504715fe11c0c0b574276b94293d1b5.jpg not downloaded yet
2026-04-27 08:09:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TK51874/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6504715fe11c0c0b574276b94293d1b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5969010>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6504715fe11c0c0b574276b94293d1b5.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NJ15500> (referer: https://www.auto1.com/v1/car-details-view/NJ15500/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 839ea42b-6c88-5a72-a4b9-775118a05c77 with identifier: NJ15500
2026-04-27 08:09:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 839ea42b-6c88-5a72-a4b9-775118a05c77 with scrape type 1
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_758a7bb962f1bbdc998e1abb6f9697b3.jpg not downloaded yet
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_16a9181f84131e8ae21cde87a8f6be79.jpg not downloaded yet
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_9cecbe044830d0458e4723438cd63b61.jpg not downloaded yet
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_da1d6d37a18aafbd4588850773187033.jpg not downloaded yet
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_a8eb40055e32023620f2d4cb18df44ad.jpg not downloaded yet
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_415cc8c51c00b091ff7b55cd625bcc0b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_a8eb40055e32023620f2d4cb18df44ad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ced0>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_415cc8c51c00b091ff7b55cd625bcc0b.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65f8950>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_a8eb40055e32023620f2d4cb18df44ad.jpg saved to cache
2026-04-27 08:09:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_da1d6d37a18aafbd4588850773187033.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_9cecbe044830d0458e4723438cd63b61.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5665550>
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_da1d6d37a18aafbd4588850773187033.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c0990>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_9cecbe044830d0458e4723438cd63b61.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_16a9181f84131e8ae21cde87a8f6be79.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587e990>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_16a9181f84131e8ae21cde87a8f6be79.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_758a7bb962f1bbdc998e1abb6f9697b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50dd0>
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_758a7bb962f1bbdc998e1abb6f9697b3.jpg saved to cache
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 839ea42b-6c88-5a72-a4b9-775118a05c77
2026-04-27 08:09:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 839ea42b-6c88-5a72-a4b9-775118a05c77, skipping ID generation
2026-04-27 08:09:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 839ea42b-6c88-5a72-a4b9-775118a05c77 with scrape type 1
2026-04-27 08:09:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 839ea42b-6c88-5a72-a4b9-775118a05c77 sending to next pipeline
2026-04-27 08:09:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 839ea42b-6c88-5a72-a4b9-775118a05c77, identifier: NJ15500
2026-04-27 08:09:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 839ea42b-6c88-5a72-a4b9-775118a05c77 with identifier: NJ15500
2026-04-27 08:09:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 839ea42b-6c88-5a72-a4b9-775118a05c77 with identifier: NJ15500
2026-04-27 08:09:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 839ea42b-6c88-5a72-a4b9-775118a05c77 with identifier: NJ15500 to the API
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_758a7bb962f1bbdc998e1abb6f9697b3.jpg>
{'auction_title': '',
'c_o_2_emission_value': 114,
'category': None,
'city': 'Roma',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:34:37Z',
'fuel_type': 'diesel',
'id': '839ea42b-6c88-5a72-a4b9-775118a05c77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ15500',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Volvo',
'model': 'V50',
'odometer': 163048,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107582,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_758a7bb962f1bbdc998e1abb6f9697b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97724,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_16a9181f84131e8ae21cde87a8f6be79.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_9cecbe044830d0458e4723438cd63b61.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71770,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_da1d6d37a18aafbd4588850773187033.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_839ea42b-6c88-5a72-a4b9-775118a05c77/839ea42b-6c88-5a72-a4b9-775118a05c77_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68644,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5c/8c/5c8ca9af2d77c73de361dfb146d6d7d9/pa/NJ15500_a8eb40055e32023620f2d4cb18df44ad.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2012-09-26',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V50 1.6 D2',
'transmission': 'manual',
'trim': '',
'year': 2012}
2026-04-27 08:09:37 [auto1.it] INFO: Saving data for NJ15500: {'created_time': 1777277377.967488, 'last_price_update_time': 1777277377.9675, 'has_photos': True, 'auction_closing_time': 1777390477.0}
2026-04-27 08:09:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_4b0a4c4c3755d3548f7bf4ca9e149f7a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760490>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_4b0a4c4c3755d3548f7bf4ca9e149f7a.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_1a61a1e0236b7c06ed0d9e673f96db77.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25810>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_1a61a1e0236b7c06ed0d9e673f96db77.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_fa753b2b89b9635c27d2a44a3f5bd86d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53b8890>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_fa753b2b89b9635c27d2a44a3f5bd86d.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_c0f33a52897a0f1936aaa8e970fe70ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55939d0>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_c0f33a52897a0f1936aaa8e970fe70ef.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_bee2619eefd4d0115d0a72123fe4c294.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483550>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_bee2619eefd4d0115d0a72123fe4c294.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6222ace34af51fa2d936fdea08ca129d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58f53d0>
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6222ace34af51fa2d936fdea08ca129d.jpg saved to cache
2026-04-27 08:09:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_f88ba7c7f8cb892c26fdd8414c4fb956.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_ca1afa72fd44dd969f4320956035cb11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52cd0>
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_f88ba7c7f8cb892c26fdd8414c4fb956.jpg saved to cache
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ95846/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a3990>
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_ca1afa72fd44dd969f4320956035cb11.jpg saved to cache
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8
2026-04-27 08:09:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8, skipping ID generation
2026-04-27 08:09:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with scrape type 1
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 sending to next pipeline
2026-04-27 08:09:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8, identifier: GZ99467
2026-04-27 08:09:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with identifier: GZ99467
2026-04-27 08:09:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with identifier: GZ99467
2026-04-27 08:09:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:09:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2ea40906-6620-5ede-8f1c-eeabf4c93dc8 with identifier: GZ99467 to the API
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:09:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_ca1afa72fd44dd969f4320956035cb11.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Settimo Torinese',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:50:03Z',
'fuel_type': 'diesel',
'id': '2ea40906-6620-5ede-8f1c-eeabf4c93dc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ99467',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volvo',
'model': 'V60',
'odometer': 114512,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74010,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_ca1afa72fd44dd969f4320956035cb11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74940,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_f88ba7c7f8cb892c26fdd8414c4fb956.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65487,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6222ace34af51fa2d936fdea08ca129d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63973,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_bee2619eefd4d0115d0a72123fe4c294.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66887,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_c0f33a52897a0f1936aaa8e970fe70ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72570,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_fa753b2b89b9635c27d2a44a3f5bd86d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_1a61a1e0236b7c06ed0d9e673f96db77.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78235,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_4b0a4c4c3755d3548f7bf4ca9e149f7a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_415cc8c51c00b091ff7b55cd625bcc0b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2ea40906-6620-5ede-8f1c-eeabf4c93dc8/2ea40906-6620-5ede-8f1c-eeabf4c93dc8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73239,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imge5/2e/e52ed9fdf7eeeb12a53d931bbb25cc91/pa/GZ99467_6504715fe11c0c0b574276b94293d1b5.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2015-09-07',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V60 2.0 D4 Momentum',
'transmission': 'manual',
'trim': 'Momentum',
'year': 2015}
2026-04-27 08:09:39 [auto1.it] INFO: Saving data for GZ99467: {'created_time': 1777277379.654473, 'last_price_update_time': 1777277379.654487, 'has_photos': True, 'auction_closing_time': 1777391403.0}
2026-04-27 08:09:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_be67b456b0f30d9d1f66e37d56954a62.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582dd0>
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_be67b456b0f30d9d1f66e37d56954a62.jpg saved to cache
2026-04-27 08:09:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_de20d71b7c6c94bca414614181b94316.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1cd50>
2026-04-27 08:09:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_de20d71b7c6c94bca414614181b94316.jpg saved to cache
2026-04-27 08:09:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:09:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BF50858/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FL08980/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PW70389> (referer: https://www.auto1.com/v1/car-details-view/PW70389/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-04-27 08:09:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with scrape type 1
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_abc463acc8b694518c5a75dda9cc6acb.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_76d5fd5842cb76b54fa17b9c2fe059b3.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_12ceacaad569a8c0c959fabb70e743f9.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b390463523929e1de5bd64fd227a8bb1.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_832c09682179d2bc8d4ba792714309ed.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b664be65d56e88065c268b904a9cad85.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_6ec3ef491458889622efc726e3195c26.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_51908b2e6b76a80b933b8622b2bf2d94.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_9d851098f791125171035612ca00d6bd.jpg not downloaded yet
2026-04-27 08:09:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_954b2a76488c4ee4b26b6bd5d5682271.jpg not downloaded yet
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WL63923/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KK79184/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_954b2a76488c4ee4b26b6bd5d5682271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_9d851098f791125171035612ca00d6bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559fc50>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_954b2a76488c4ee4b26b6bd5d5682271.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551c150>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_9d851098f791125171035612ca00d6bd.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UR17084/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:09:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_51908b2e6b76a80b933b8622b2bf2d94.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d6250>
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:09:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:09:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_51908b2e6b76a80b933b8622b2bf2d94.jpg saved to cache
2026-04-27 08:09:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:09:59 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.206(s), this was the 1st time calling it.
2026-04-27 08:09:59 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.933839841717911 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FW29244/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_6ec3ef491458889622efc726e3195c26.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5950a10>
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_6ec3ef491458889622efc726e3195c26.jpg saved to cache
2026-04-27 08:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JA34507> (referer: https://www.auto1.com/v1/car-details-view/JA34507/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with identifier: JA34507
2026-04-27 08:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with scrape type 1
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_67d693f57ac971cbfda5b7e448eb6ed0.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_8dd71f2c53f068367e2875db81d00403.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_34ae17211fd53c96fba014867247f933.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_7be4e482820524c5a1c159ba91de88ac.jpg not downloaded yet
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_37328f561dd5c84f532c62dc752fedf3.jpg not downloaded yet
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b664be65d56e88065c268b904a9cad85.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a1fd0>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b664be65d56e88065c268b904a9cad85.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_37328f561dd5c84f532c62dc752fedf3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5961cd0>
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:07 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_37328f561dd5c84f532c62dc752fedf3.jpg saved to cache
2026-04-27 08:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_7be4e482820524c5a1c159ba91de88ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5ab93d0>
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_7be4e482820524c5a1c159ba91de88ac.jpg saved to cache
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_34ae17211fd53c96fba014867247f933.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577aa10>
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_34ae17211fd53c96fba014867247f933.jpg saved to cache
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_8dd71f2c53f068367e2875db81d00403.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_67d693f57ac971cbfda5b7e448eb6ed0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5769650>
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_8dd71f2c53f068367e2875db81d00403.jpg saved to cache
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577a210>
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_67d693f57ac971cbfda5b7e448eb6ed0.jpg saved to cache
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f
2026-04-27 08:10:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f, skipping ID generation
2026-04-27 08:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with scrape type 1
2026-04-27 08:10:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f sending to next pipeline
2026-04-27 08:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f, identifier: JA34507
2026-04-27 08:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with identifier: JA34507
2026-04-27 08:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with identifier: JA34507
2026-04-27 08:10:08 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7c130f2d-bcf3-5b53-81b5-72ff2b914c8f with identifier: JA34507 to the API
2026-04-27 08:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_67d693f57ac971cbfda5b7e448eb6ed0.jpg>
{'auction_title': '',
'c_o_2_emission_value': 165,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 143,
'expiration_date': '2026-04-28T15:22:51Z',
'fuel_type': 'diesel',
'id': '7c130f2d-bcf3-5b53-81b5-72ff2b914c8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JA34507',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'BMW',
'model': 'X3',
'odometer': 182711,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_67d693f57ac971cbfda5b7e448eb6ed0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78874,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_8dd71f2c53f068367e2875db81d00403.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_34ae17211fd53c96fba014867247f933.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84509,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_7be4e482820524c5a1c159ba91de88ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7c130f2d-bcf3-5b53-81b5-72ff2b914c8f/7c130f2d-bcf3-5b53-81b5-72ff2b914c8f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96220,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb4/ef/b4ef58794f3dca0601c53e10f639c9bf/pa/JA34507_37328f561dd5c84f532c62dc752fedf3.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2010-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 xDrive 18d',
'transmission': 'manual',
'trim': '',
'year': 2010}
2026-04-27 08:10:09 [auto1.it] INFO: Saving data for JA34507: {'created_time': 1777277409.181414, 'last_price_update_time': 1777277409.181424, 'has_photos': True, 'auction_closing_time': 1777389771.0}
2026-04-27 08:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_832c09682179d2bc8d4ba792714309ed.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54de150>
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_832c09682179d2bc8d4ba792714309ed.jpg saved to cache
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b390463523929e1de5bd64fd227a8bb1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dc950>
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b390463523929e1de5bd64fd227a8bb1.jpg saved to cache
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_12ceacaad569a8c0c959fabb70e743f9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57af890>
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_12ceacaad569a8c0c959fabb70e743f9.jpg saved to cache
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_76d5fd5842cb76b54fa17b9c2fe059b3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_abc463acc8b694518c5a75dda9cc6acb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5950d50>
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_76d5fd5842cb76b54fa17b9c2fe059b3.jpg saved to cache
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577ba90>
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:09 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_abc463acc8b694518c5a75dda9cc6acb.jpg saved to cache
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222
2026-04-27 08:10:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f06d1f89-d4a6-56fd-81a4-83dfc34eb222, skipping ID generation
2026-04-27 08:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with scrape type 1
2026-04-27 08:10:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f06d1f89-d4a6-56fd-81a4-83dfc34eb222 sending to next pipeline
2026-04-27 08:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f06d1f89-d4a6-56fd-81a4-83dfc34eb222, identifier: PW70389
2026-04-27 08:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-04-27 08:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389
2026-04-27 08:10:10 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f06d1f89-d4a6-56fd-81a4-83dfc34eb222 with identifier: PW70389 to the API
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_abc463acc8b694518c5a75dda9cc6acb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'category': None,
'city': 'Varedo',
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:36:23Z',
'fuel_type': 'diesel',
'id': 'f06d1f89-d4a6-56fd-81a4-83dfc34eb222',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PW70389',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Fiat',
'model': '500L',
'odometer': 185536,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79921,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_abc463acc8b694518c5a75dda9cc6acb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_76d5fd5842cb76b54fa17b9c2fe059b3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58148,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_12ceacaad569a8c0c959fabb70e743f9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69349,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b390463523929e1de5bd64fd227a8bb1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55130,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_832c09682179d2bc8d4ba792714309ed.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_b664be65d56e88065c268b904a9cad85.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64363,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_6ec3ef491458889622efc726e3195c26.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84473,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_51908b2e6b76a80b933b8622b2bf2d94.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80626,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_9d851098f791125171035612ca00d6bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f06d1f89-d4a6-56fd-81a4-83dfc34eb222/f06d1f89-d4a6-56fd-81a4-83dfc34eb222_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57472,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img43/88/4388de1888c642b057e045075364c1f0/pa/PW70389_954b2a76488c4ee4b26b6bd5d5682271.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2017-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat 500L 1.3 M-Jet Trekking',
'transmission': 'manual',
'trim': 'Trekking',
'year': 2017}
2026-04-27 08:10:10 [auto1.it] INFO: Saving data for PW70389: {'created_time': 1777277410.399405, 'last_price_update_time': 1777277410.399416, 'has_photos': True, 'auction_closing_time': 1777390583.0}
2026-04-27 08:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_dececbd385535126211ef1012bcca82f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:10 [scrapy.extensions.logstats] INFO: Crawled 591 pages (at 17 pages/min), scraped 254 items (at 8 items/min)
2026-04-27 08:10:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_4fdbe9bf16a572c00470b10f97905390.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7290>
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_dececbd385535126211ef1012bcca82f.jpg saved to cache
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4eb6b50>
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_4fdbe9bf16a572c00470b10f97905390.jpg saved to cache
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_07976ccffe9821bb5c7739ca4e38d912.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_c4f77af3b316c4784b3692dba4f3675a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5951750>
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_07976ccffe9821bb5c7739ca4e38d912.jpg saved to cache
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c6d50>
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:10 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_c4f77af3b316c4784b3692dba4f3675a.jpg saved to cache
2026-04-27 08:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AK30543/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_acd4890f4a3907255a40a3277a535826.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559fc50>
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_acd4890f4a3907255a40a3277a535826.jpg saved to cache
2026-04-27 08:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NW55395/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_000e661b1085da1f67f49ea63c040181.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c7450>
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_000e661b1085da1f67f49ea63c040181.jpg saved to cache
2026-04-27 08:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CF78450/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BF50858> (referer: https://www.auto1.com/v1/car-details-view/BF50858/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FL08980> (referer: https://www.auto1.com/v1/car-details-view/FL08980/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with identifier: BF50858
2026-04-27 08:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with scrape type 1
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_31c9d2e2a4dd20a8dcab5feb58b4b88e.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_0bbfb58dfbc2e1969da912a60169ba59.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_010cd74d10fac0ef6386e4749a070ee2.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_73101179c4dcaca43345a93f93b4d1dc.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_9b42dd6df62dca240405eb8d71160d0c.jpg not downloaded yet
2026-04-27 08:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-04-27 08:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a380435-8274-5744-991b-9ee45a57966b with scrape type 1
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_a43780ec3a5bfd84ff74ec1ec2b09a49.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_e882e87c4e4b5cdb61b16bae1cd29b6a.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_409366fc6ca1de3d464e15e80d9569a1.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_4e60a18cd7fc57f566f50aa6e6720e3b.jpg not downloaded yet
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_966386dda86b4fe77730bc8a55baf930.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_bd3636e84a09b926415c62e0089aed23.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_353d520ce20fc1bb294fb701f77ed82b.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_56d158ab6b3992a76420fd07468163e8.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_95f95881ee3dd84791fb72695a82cb93.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_8d51e7e091b36f77fbde84daf710682e.jpg not downloaded yet
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_cea25a89132227615630aab54dd3c3ac.jpg not downloaded yet
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_4e60a18cd7fc57f566f50aa6e6720e3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c43d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_966386dda86b4fe77730bc8a55baf930.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c6850>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_4e60a18cd7fc57f566f50aa6e6720e3b.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_cea25a89132227615630aab54dd3c3ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dde90>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_cea25a89132227615630aab54dd3c3ac.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_8d51e7e091b36f77fbde84daf710682e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f2b50>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_8d51e7e091b36f77fbde84daf710682e.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_95f95881ee3dd84791fb72695a82cb93.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c12d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_95f95881ee3dd84791fb72695a82cb93.jpg saved to cache
2026-04-27 08:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_56d158ab6b3992a76420fd07468163e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59db2d0>
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_56d158ab6b3992a76420fd07468163e8.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_353d520ce20fc1bb294fb701f77ed82b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c1050>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_353d520ce20fc1bb294fb701f77ed82b.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_bd3636e84a09b926415c62e0089aed23.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WL63923> (referer: https://www.auto1.com/v1/car-details-view/WL63923/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6790>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_bd3636e84a09b926415c62e0089aed23.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_409366fc6ca1de3d464e15e80d9569a1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_a43780ec3a5bfd84ff74ec1ec2b09a49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c848b03-b343-5da3-9af4-e703437ef8e4 with identifier: WL63923
2026-04-27 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c848b03-b343-5da3-9af4-e703437ef8e4 with scrape type 1
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_af24f57cca00f393cce229031acd75ac.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_70b57d443a7c80dbcc3838138a0bb678.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_068fe8aaccf545ecdf100504470a9fab.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_65ceedfca125f96db1448f194178ef45.jpg not downloaded yet
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5480a50>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_409366fc6ca1de3d464e15e80d9569a1.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_905da2cd53f5e2694853d7a665e47906.jpg not downloaded yet
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_9b42dd6df62dca240405eb8d71160d0c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533af10>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_a43780ec3a5bfd84ff74ec1ec2b09a49.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_cbed1b5c59bf9a1cf7b110eec8eb2af4.jpg not downloaded yet
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_e882e87c4e4b5cdb61b16bae1cd29b6a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_9a9c5e9e25333f3de1d85d2c60b78a65.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_a4b1153bfecb4a395603988464ff246d.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_03586bc303ed3b88a44e5bd945a7dd68.jpg not downloaded yet
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_f1e4922661f4a6b89f0f212ca377596c.jpg not downloaded yet
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c6d0>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_9b42dd6df62dca240405eb8d71160d0c.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_cbed1b5c59bf9a1cf7b110eec8eb2af4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839ad10>
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_e882e87c4e4b5cdb61b16bae1cd29b6a.jpg saved to cache
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a380435-8274-5744-991b-9ee45a57966b
2026-04-27 08:10:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a380435-8274-5744-991b-9ee45a57966b, skipping ID generation
2026-04-27 08:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a380435-8274-5744-991b-9ee45a57966b with scrape type 1
2026-04-27 08:10:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a380435-8274-5744-991b-9ee45a57966b sending to next pipeline
2026-04-27 08:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 6a380435-8274-5744-991b-9ee45a57966b, identifier: FL08980
2026-04-27 08:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-04-27 08:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980
2026-04-27 08:10:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6a380435-8274-5744-991b-9ee45a57966b with identifier: FL08980 to the API
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_e882e87c4e4b5cdb61b16bae1cd29b6a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '3.0L',
'engine_horse_power': 262,
'expiration_date': '2026-04-28T15:13:14Z',
'fuel_type': 'diesel',
'id': '6a380435-8274-5744-991b-9ee45a57966b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FL08980',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Volkswagen',
'model': 'Touareg',
'odometer': 130655,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_a43780ec3a5bfd84ff74ec1ec2b09a49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73121,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_e882e87c4e4b5cdb61b16bae1cd29b6a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_409366fc6ca1de3d464e15e80d9569a1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64431,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_4e60a18cd7fc57f566f50aa6e6720e3b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_bd3636e84a09b926415c62e0089aed23.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71394,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_353d520ce20fc1bb294fb701f77ed82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_56d158ab6b3992a76420fd07468163e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_95f95881ee3dd84791fb72695a82cb93.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_8d51e7e091b36f77fbde84daf710682e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6a380435-8274-5744-991b-9ee45a57966b/6a380435-8274-5744-991b-9ee45a57966b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/04/490474649c49db5fd433059646c7e866/pa/FL08980_cea25a89132227615630aab54dd3c3ac.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2015-12-17',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Touareg 3.0 V6 TDI Terrain Tech BlueMotion Tech',
'transmission': 'automatic',
'trim': 'Terrain Tech BlueMotion Tech',
'year': 2015}
2026-04-27 08:10:22 [auto1.it] INFO: Saving data for FL08980: {'created_time': 1777277422.374039, 'last_price_update_time': 1777277422.37405, 'has_photos': True, 'auction_closing_time': 1777389194.0}
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_65ceedfca125f96db1448f194178ef45.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_f1e4922661f4a6b89f0f212ca377596c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a94310>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_cbed1b5c59bf9a1cf7b110eec8eb2af4.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5646890>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_65ceedfca125f96db1448f194178ef45.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_a4b1153bfecb4a395603988464ff246d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5779d10>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_f1e4922661f4a6b89f0f212ca377596c.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_03586bc303ed3b88a44e5bd945a7dd68.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8398d50>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_a4b1153bfecb4a395603988464ff246d.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5924390>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_03586bc303ed3b88a44e5bd945a7dd68.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_905da2cd53f5e2694853d7a665e47906.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_9a9c5e9e25333f3de1d85d2c60b78a65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_70b57d443a7c80dbcc3838138a0bb678.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d7dd0>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_905da2cd53f5e2694853d7a665e47906.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_068fe8aaccf545ecdf100504470a9fab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_af24f57cca00f393cce229031acd75ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65fae50>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_9a9c5e9e25333f3de1d85d2c60b78a65.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_010cd74d10fac0ef6386e4749a070ee2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555c250>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_70b57d443a7c80dbcc3838138a0bb678.jpg saved to cache
2026-04-27 08:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5925b90>
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_068fe8aaccf545ecdf100504470a9fab.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c4dd0>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_af24f57cca00f393cce229031acd75ac.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c848b03-b343-5da3-9af4-e703437ef8e4
2026-04-27 08:10:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c848b03-b343-5da3-9af4-e703437ef8e4, skipping ID generation
2026-04-27 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c848b03-b343-5da3-9af4-e703437ef8e4 with scrape type 1
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c848b03-b343-5da3-9af4-e703437ef8e4 sending to next pipeline
2026-04-27 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2c848b03-b343-5da3-9af4-e703437ef8e4, identifier: WL63923
2026-04-27 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2c848b03-b343-5da3-9af4-e703437ef8e4 with identifier: WL63923
2026-04-27 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2c848b03-b343-5da3-9af4-e703437ef8e4 with identifier: WL63923
2026-04-27 08:10:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2c848b03-b343-5da3-9af4-e703437ef8e4 with identifier: WL63923 to the API
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_af24f57cca00f393cce229031acd75ac.jpg>
{'auction_title': '',
'c_o_2_emission_value': 178,
'category': None,
'city': 'Varedo',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '3.0L',
'engine_horse_power': 286,
'expiration_date': '2026-04-28T15:24:34Z',
'fuel_type': 'diesel',
'id': '2c848b03-b343-5da3-9af4-e703437ef8e4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL63923',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Audi',
'model': 'Q8',
'odometer': 60957,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68755,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_af24f57cca00f393cce229031acd75ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47352,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_70b57d443a7c80dbcc3838138a0bb678.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76304,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_068fe8aaccf545ecdf100504470a9fab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62120,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_65ceedfca125f96db1448f194178ef45.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_905da2cd53f5e2694853d7a665e47906.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75589,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_cbed1b5c59bf9a1cf7b110eec8eb2af4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_9a9c5e9e25333f3de1d85d2c60b78a65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67579,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_a4b1153bfecb4a395603988464ff246d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69817,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_03586bc303ed3b88a44e5bd945a7dd68.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2c848b03-b343-5da3-9af4-e703437ef8e4/2c848b03-b343-5da3-9af4-e703437ef8e4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83857,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img86/2d/862dec75374188b7d6c4a0a6ac9de4b6/pa/WL63923_f1e4922661f4a6b89f0f212ca377596c.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2019-04-10',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q8 50 TDI quattro Sport',
'transmission': 'automatic',
'trim': 'quattro Sport',
'year': 2019}
2026-04-27 08:10:23 [auto1.it] INFO: Saving data for WL63923: {'created_time': 1777277423.542224, 'last_price_update_time': 1777277423.542239, 'has_photos': True, 'auction_closing_time': 1777389874.0}
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_0bbfb58dfbc2e1969da912a60169ba59.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_73101179c4dcaca43345a93f93b4d1dc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KK79184> (referer: https://www.auto1.com/v1/car-details-view/KK79184/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aba610>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_010cd74d10fac0ef6386e4749a070ee2.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_31c9d2e2a4dd20a8dcab5feb58b4b88e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f69d0>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_0bbfb58dfbc2e1969da912a60169ba59.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_cd10cb55b20843ac30d8bc1e6539f304.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555ef90>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_73101179c4dcaca43345a93f93b4d1dc.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ce2d42d-1489-5f74-a0ae-1de771247719 with identifier: KK79184
2026-04-27 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ce2d42d-1489-5f74-a0ae-1de771247719 with scrape type 1
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_035dd905326bd87c907f938b48ff85e6.jpg not downloaded yet
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_6c7831e344de305a3a4c7f7158663958.jpg not downloaded yet
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_02c3ed094493ac893c73251b6f216e17.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_a8148af7645d26e978210f728e368065.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_a564603cd9db43f379c9778640ce8e15.jpg not downloaded yet
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5925a90>
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_31c9d2e2a4dd20a8dcab5feb58b4b88e.jpg saved to cache
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26
2026-04-27 08:10:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0152f6d6-0c97-5bbb-9e22-603fe2361f26, skipping ID generation
2026-04-27 08:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with scrape type 1
2026-04-27 08:10:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0152f6d6-0c97-5bbb-9e22-603fe2361f26 sending to next pipeline
2026-04-27 08:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0152f6d6-0c97-5bbb-9e22-603fe2361f26, identifier: BF50858
2026-04-27 08:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with identifier: BF50858
2026-04-27 08:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with identifier: BF50858
2026-04-27 08:10:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0152f6d6-0c97-5bbb-9e22-603fe2361f26 with identifier: BF50858 to the API
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_31c9d2e2a4dd20a8dcab5feb58b4b88e.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Roma',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:35:50Z',
'fuel_type': 'petrol',
'id': '0152f6d6-0c97-5bbb-9e22-603fe2361f26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF50858',
'listing': 'auction',
'location': 'IT, Roma RM',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Fiat',
'model': 'Punto',
'odometer': 141988,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78823,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_31c9d2e2a4dd20a8dcab5feb58b4b88e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78656,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_0bbfb58dfbc2e1969da912a60169ba59.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69280,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_010cd74d10fac0ef6386e4749a070ee2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79202,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_73101179c4dcaca43345a93f93b4d1dc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0152f6d6-0c97-5bbb-9e22-603fe2361f26/0152f6d6-0c97-5bbb-9e22-603fe2361f26_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51445,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img93/e5/93e5c9245d61e86eca3fcfc6e3bd332b/pa/BF50858_9b42dd6df62dca240405eb8d71160d0c.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2008-10-08',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.2 Classic Dynamic',
'transmission': 'manual',
'trim': 'Classic Dynamic',
'year': 2008}
2026-04-27 08:10:24 [auto1.it] INFO: Saving data for BF50858: {'created_time': 1777277424.288618, 'last_price_update_time': 1777277424.288626, 'has_photos': True, 'auction_closing_time': 1777390550.0}
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_07677c67644b7a1daee12d56cfd81274.jpg not downloaded yet
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95090>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_cd10cb55b20843ac30d8bc1e6539f304.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55bec90>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_02c3ed094493ac893c73251b6f216e17.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ad210>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_a8148af7645d26e978210f728e368065.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_dc9208cb293cc4617834a2d87e6eaf2b.jpg not downloaded yet
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_035dd905326bd87c907f938b48ff85e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_3fd50a3bc599adc31a710ab7b5db9eb8.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_235ee17e73f67377416238733447550a.jpg not downloaded yet
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_6c7831e344de305a3a4c7f7158663958.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_763ca4f1210958c554453d3007a76495.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_5238ebeff32218dcdd723263554c423f.jpg not downloaded yet
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_f52bdc3cd4118821c4b373601f11bca5.jpg not downloaded yet
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a29bd0>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_035dd905326bd87c907f938b48ff85e6.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8b50>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_6c7831e344de305a3a4c7f7158663958.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_dc9208cb293cc4617834a2d87e6eaf2b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_235ee17e73f67377416238733447550a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bcd50>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_dc9208cb293cc4617834a2d87e6eaf2b.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_f52bdc3cd4118821c4b373601f11bca5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548d010>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_235ee17e73f67377416238733447550a.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_5238ebeff32218dcdd723263554c423f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0050>
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_f52bdc3cd4118821c4b373601f11bca5.jpg saved to cache
2026-04-27 08:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ95846> (referer: https://www.auto1.com/v1/car-details-view/DZ95846/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aaa710>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_5238ebeff32218dcdd723263554c423f.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f8776f4-cd32-5efd-af38-95e60467e17e with identifier: DZ95846
2026-04-27 08:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f8776f4-cd32-5efd-af38-95e60467e17e with scrape type 1
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_90fbe347816280c422d54b2e509ba6fc.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_763ca4f1210958c554453d3007a76495.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_3fd50a3bc599adc31a710ab7b5db9eb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_83e6d4b834db180d534854f9b06bf1a2.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_7f6f3547088725eaa20264e04e9fbbde.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_91c9bc7bd40a3060cb3a9262f0aa7767.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_a005068e46a084fc0436c83c1f2a2186.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_90fbe347816280c422d54b2e509ba6fc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_c261f827bec222e83b0d22d5f2066f69.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_9ff9b0cb1eddb886263aa034ac845bb2.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_631ab1e8fc740efdac4b2f6e48fdc4ab.jpg not downloaded yet
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_d2a56e7c5411110b1d6462a92aa0e069.jpg not downloaded yet
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59bcc10>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_763ca4f1210958c554453d3007a76495.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d4990>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_3fd50a3bc599adc31a710ab7b5db9eb8.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_91c9bc7bd40a3060cb3a9262f0aa7767.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_46d36d68d9ef84aa498251646eb70c19.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_a564603cd9db43f379c9778640ce8e15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UR17084> (referer: https://www.auto1.com/v1/car-details-view/UR17084/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dba10>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_90fbe347816280c422d54b2e509ba6fc.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_d2a56e7c5411110b1d6462a92aa0e069.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c3c10>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_91c9bc7bd40a3060cb3a9262f0aa7767.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_9ff9b0cb1eddb886263aa034ac845bb2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63844d0>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_a564603cd9db43f379c9778640ce8e15.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0ce2d42d-1489-5f74-a0ae-1de771247719
2026-04-27 08:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-04-27 08:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af with scrape type 1
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_46d36d68d9ef84aa498251646eb70c19.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_c261f827bec222e83b0d22d5f2066f69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg not downloaded yet
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587c1d0>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_d2a56e7c5411110b1d6462a92aa0e069.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg not downloaded yet
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg not downloaded yet
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483290>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_9ff9b0cb1eddb886263aa034ac845bb2.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_a005068e46a084fc0436c83c1f2a2186.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5e50>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_46d36d68d9ef84aa498251646eb70c19.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead596a4d0>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_c261f827bec222e83b0d22d5f2066f69.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5558310>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a25410>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_a005068e46a084fc0436c83c1f2a2186.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5010>
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg saved to cache
2026-04-27 08:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FW29244> (referer: https://www.auto1.com/v1/car-details-view/FW29244/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55581d0>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6010>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_7f6f3547088725eaa20264e04e9fbbde.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0ce2d42d-1489-5f74-a0ae-1de771247719 with identifier: KK79184
2026-04-27 08:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0ce2d42d-1489-5f74-a0ae-1de771247719 with identifier: KK79184
2026-04-27 08:10:26 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0ce2d42d-1489-5f74-a0ae-1de771247719 with identifier: KK79184 to the API
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:26 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 175,
'category': None,
'city': 'Capua',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.1L',
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:09:05Z',
'fuel_type': 'diesel',
'id': '0ce2d42d-1489-5f74-a0ae-1de771247719',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK79184',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Jeep',
'model': 'Cherokee',
'odometer': 105252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_035dd905326bd87c907f938b48ff85e6.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_6c7831e344de305a3a4c7f7158663958.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_a564603cd9db43f379c9778640ce8e15.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_07677c67644b7a1daee12d56cfd81274.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_dc9208cb293cc4617834a2d87e6eaf2b.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_3fd50a3bc599adc31a710ab7b5db9eb8.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_235ee17e73f67377416238733447550a.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_763ca4f1210958c554453d3007a76495.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_5238ebeff32218dcdd723263554c423f.jpg',
'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_f52bdc3cd4118821c4b373601f11bca5.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116595,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_035dd905326bd87c907f938b48ff85e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112648,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_6c7831e344de305a3a4c7f7158663958.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_a564603cd9db43f379c9778640ce8e15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86859,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_dc9208cb293cc4617834a2d87e6eaf2b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_3fd50a3bc599adc31a710ab7b5db9eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70806,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_235ee17e73f67377416238733447550a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_763ca4f1210958c554453d3007a76495.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103526,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_5238ebeff32218dcdd723263554c423f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0ce2d42d-1489-5f74-a0ae-1de771247719/0ce2d42d-1489-5f74-a0ae-1de771247719_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img95/f6/95f6eb02b9fd6808892d7bf2e4e56098/pa/KK79184_f52bdc3cd4118821c4b373601f11bca5.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-11-28',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Cherokee 2.2 M-Jet Longitude 4WD',
'transmission': 'automatic',
'trim': 'Longitude 4WD',
'year': 2019}
2026-04-27 08:10:26 [auto1.it] INFO: Saving data for KK79184: {'created_time': 1777277426.801321, 'last_price_update_time': 1777277426.801332, 'has_photos': True, 'auction_closing_time': 1777388945.0}
2026-04-27 08:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_849043b33ddc1de1c669b2f0008fa61f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 0ce2d42d-1489-5f74-a0ae-1de771247719 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd with identifier: FW29244
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd with scrape type 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_730c82c750240b9b0f236c3ef5536e4d.jpg not downloaded yet
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_e88aaec179dcf90cbb66bd4736d2c999.jpg not downloaded yet
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e410>
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg saved to cache
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af
2026-04-27 08:10:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f80bdab-b6ba-57d6-ac40-43a30cd592af, skipping ID generation
2026-04-27 08:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af with scrape type 1
2026-04-27 08:10:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f80bdab-b6ba-57d6-ac40-43a30cd592af sending to next pipeline
2026-04-27 08:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 4f80bdab-b6ba-57d6-ac40-43a30cd592af, identifier: UR17084
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762150>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_7f6f3547088725eaa20264e04e9fbbde.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f8776f4-cd32-5efd-af38-95e60467e17e
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_591e5711aaabd993495ca6a4637b9781.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-04-27 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084
2026-04-27 08:10:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4f80bdab-b6ba-57d6-ac40-43a30cd592af with identifier: UR17084 to the API
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 174,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.1L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:12:49Z',
'fuel_type': 'diesel',
'id': '4f80bdab-b6ba-57d6-ac40-43a30cd592af',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UR17084',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Mercedes-Benz',
'model': 'E-Klasse',
'odometer': 385252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96649,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_36397e4c8da7bffa485b40298ed064b4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86146,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_157c5913c798b4da8c396617463b97eb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_57d26ac64e54724316964d8bba16f5fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62545,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_5af4a7c811370fb5dd09d4e11048374e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4f80bdab-b6ba-57d6-ac40-43a30cd592af/4f80bdab-b6ba-57d6-ac40-43a30cd592af_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8ebf03be867bbc61c41ffbefb5579a9/pa/UR17084_beff3219778722e35478b8a46a995806.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2007-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz E-Klasse E 220 CDI Elegance',
'transmission': 'automatic',
'trim': 'Elegance',
'year': 2007}
2026-04-27 08:10:27 [auto1.it] INFO: Saving data for UR17084: {'created_time': 1777277427.4699, 'last_price_update_time': 1777277427.469914, 'has_photos': True, 'auction_closing_time': 1777389169.0}
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_e2673be9621857c91b0c781672a51074.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_69f30d44330268367e5fea00362e315f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7f8776f4-cd32-5efd-af38-95e60467e17e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_7ad11866872700d5b3d179fd12d7d71d.jpg not downloaded yet
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5481650>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_849043b33ddc1de1c669b2f0008fa61f.jpg saved to cache
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_8f8e589723d4da616dde522ffd194da2.jpg not downloaded yet
2026-04-27 08:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 7f8776f4-cd32-5efd-af38-95e60467e17e with identifier: DZ95846
2026-04-27 08:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 7f8776f4-cd32-5efd-af38-95e60467e17e with identifier: DZ95846
2026-04-27 08:10:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 7f8776f4-cd32-5efd-af38-95e60467e17e with identifier: DZ95846 to the API
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:27 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'city': 'Bentivoglio',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 210,
'expiration_date': '2026-04-28T15:27:07Z',
'fuel_type': 'diesel',
'id': '7f8776f4-cd32-5efd-af38-95e60467e17e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6369,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ95846',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'location_confidence': 'geocoded',
'longitude': 11.4174,
'make': 'Ford',
'model': 'Edge',
'odometer': 175125,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_90fbe347816280c422d54b2e509ba6fc.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_83e6d4b834db180d534854f9b06bf1a2.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_7f6f3547088725eaa20264e04e9fbbde.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_91c9bc7bd40a3060cb3a9262f0aa7767.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_a005068e46a084fc0436c83c1f2a2186.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_c261f827bec222e83b0d22d5f2066f69.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_9ff9b0cb1eddb886263aa034ac845bb2.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_631ab1e8fc740efdac4b2f6e48fdc4ab.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_d2a56e7c5411110b1d6462a92aa0e069.jpg',
'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_46d36d68d9ef84aa498251646eb70c19.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_90fbe347816280c422d54b2e509ba6fc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70715,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_7f6f3547088725eaa20264e04e9fbbde.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_91c9bc7bd40a3060cb3a9262f0aa7767.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59334,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_a005068e46a084fc0436c83c1f2a2186.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66386,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_c261f827bec222e83b0d22d5f2066f69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46777,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_9ff9b0cb1eddb886263aa034ac845bb2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72190,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_d2a56e7c5411110b1d6462a92aa0e069.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_7f8776f4-cd32-5efd-af38-95e60467e17e/7f8776f4-cd32-5efd-af38-95e60467e17e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51154,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img64/c5/64c579afc676e785899e8a30482e1db1/pa/DZ95846_46d36d68d9ef84aa498251646eb70c19.jpg',
'Width': 800}],
'postal_code': '40010',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2016-11-07',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Edge 2.0 TDCi Bi-Turbo Sport 4x4',
'transmission': 'automatic',
'trim': 'Sport 4x4',
'year': 2016}
2026-04-27 08:10:27 [auto1.it] INFO: Saving data for DZ95846: {'created_time': 1777277427.947028, 'last_price_update_time': 1777277427.947041, 'has_photos': True, 'auction_closing_time': 1777390027.0}
2026-04-27 08:10:27 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 7f8776f4-cd32-5efd-af38-95e60467e17e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_730c82c750240b9b0f236c3ef5536e4d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_591e5711aaabd993495ca6a4637b9781.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5834e10>
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:27 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_e2673be9621857c91b0c781672a51074.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e6050>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_69f30d44330268367e5fea00362e315f.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8810>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_730c82c750240b9b0f236c3ef5536e4d.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59635d0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_591e5711aaabd993495ca6a4637b9781.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_8f8e589723d4da616dde522ffd194da2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_7ad11866872700d5b3d179fd12d7d71d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AK30543> (referer: https://www.auto1.com/v1/car-details-view/AK30543/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_800a9613cba9ab3beb67d196702476b2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_f3a1ee907fefe7bfa69914ebe9b6f056.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1150>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_8f8e589723d4da616dde522ffd194da2.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5934050>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_7ad11866872700d5b3d179fd12d7d71d.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_b5ba380f0f3db7ecf03311ecc652d644.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10e1346-3ffd-5c97-9037-2f0bf92fef30 with identifier: AK30543
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10e1346-3ffd-5c97-9037-2f0bf92fef30 with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item d10e1346-3ffd-5c97-9037-2f0bf92fef30
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_9b28a4aa286795b59bea95ae691f8256.jpg not downloaded yet
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5498210>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_800a9613cba9ab3beb67d196702476b2.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58bb8d0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_f3a1ee907fefe7bfa69914ebe9b6f056.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_78abafcc93d887367e6c7a203549d10b.jpg not downloaded yet
2026-04-27 08:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TK51874> (referer: https://www.auto1.com/v1/car-details-view/TK51874/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_44bf4b0455ad06cb616e115fe899123c.jpg not downloaded yet
2026-04-27 08:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58823d0>
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_b5ba380f0f3db7ecf03311ecc652d644.jpg saved to cache
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1
2026-04-27 08:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1, skipping ID generation
2026-04-27 08:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with scrape type 1
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 sending to next pipeline
2026-04-27 08:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1, identifier: SE74727
2026-04-27 08:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_a9ad3872f8dddd6e92fc94141a27973e.jpg not downloaded yet
2026-04-27 08:10:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-04-27 08:10:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727
2026-04-27 08:10:28 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 045ade15-e9cc-50e2-ade8-bb89d9ba3ed1 with identifier: SE74727 to the API
2026-04-27 08:10:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_b5ba380f0f3db7ecf03311ecc652d644.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Milano',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '1.6L',
'engine_horse_power': 141,
'expiration_date': '2026-04-28T15:03:48Z',
'fuel_type': 'hybrid',
'id': '045ade15-e9cc-50e2-ade8-bb89d9ba3ed1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE74727',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Kia',
'model': 'Niro',
'odometer': 123900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92009,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_f3a1ee907fefe7bfa69914ebe9b6f056.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93753,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_b5ba380f0f3db7ecf03311ecc652d644.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89138,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_e2673be9621857c91b0c781672a51074.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_69f30d44330268367e5fea00362e315f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87311,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_a8148af7645d26e978210f728e368065.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94307,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_02c3ed094493ac893c73251b6f216e17.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_000e661b1085da1f67f49ea63c040181.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99068,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_c4f77af3b316c4784b3692dba4f3675a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94430,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_4fdbe9bf16a572c00470b10f97905390.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_045ade15-e9cc-50e2-ade8-bb89d9ba3ed1/045ade15-e9cc-50e2-ade8-bb89d9ba3ed1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88581,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgeb/be/ebbe80516d1ef255ff176f57059e83c5/pa/SE74727_de20d71b7c6c94bca414614181b94316.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2018-11-21',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Niro 1.6 Plug-in Hybrid',
'transmission': 'automatic',
'trim': '',
'year': 2018}
2026-04-27 08:10:29 [auto1.it] INFO: Saving data for SE74727: {'created_time': 1777277429.318848, 'last_price_update_time': 1777277429.318863, 'has_photos': True, 'auction_closing_time': 1777388628.0}
2026-04-27 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 6791cdf3-59fd-515b-97e6-02512e00d8c8 with identifier: NW41660
2026-04-27 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 6791cdf3-59fd-515b-97e6-02512e00d8c8 with identifier: NW41660
2026-04-27 08:10:29 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 6791cdf3-59fd-515b-97e6-02512e00d8c8 with identifier: NW41660 to the API
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:29 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:29 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Varedo',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 192,
'expiration_date': '2026-04-28T15:51:21Z',
'fuel_type': 'petrol',
'id': '6791cdf3-59fd-515b-97e6-02512e00d8c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NW41660',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'BMW',
'model': 'X1',
'odometer': 49470,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_800a9613cba9ab3beb67d196702476b2.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_250a5fdec62e9116a70b70e8355bb952.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_190db6c23d17491c8c6486dd64c9f69e.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_849043b33ddc1de1c669b2f0008fa61f.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_cd10cb55b20843ac30d8bc1e6539f304.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_966386dda86b4fe77730bc8a55baf930.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_acd4890f4a3907255a40a3277a535826.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_07976ccffe9821bb5c7739ca4e38d912.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_dececbd385535126211ef1012bcca82f.jpg',
'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_be67b456b0f30d9d1f66e37d56954a62.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_800a9613cba9ab3beb67d196702476b2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64217,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_190db6c23d17491c8c6486dd64c9f69e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_849043b33ddc1de1c669b2f0008fa61f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57023,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_cd10cb55b20843ac30d8bc1e6539f304.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_966386dda86b4fe77730bc8a55baf930.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47406,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_acd4890f4a3907255a40a3277a535826.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_07976ccffe9821bb5c7739ca4e38d912.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64896,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_dececbd385535126211ef1012bcca82f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_6791cdf3-59fd-515b-97e6-02512e00d8c8/6791cdf3-59fd-515b-97e6-02512e00d8c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55674,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgc4/66/c46655f05dbfdac25b81de282bce453a/pa/NW41660_be67b456b0f30d9d1f66e37d56954a62.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2019-05-29',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X1 sDrive 20i xLine',
'transmission': 'automatic',
'trim': 'xLine',
'year': 2019}
2026-04-27 08:10:29 [auto1.it] INFO: Saving data for NW41660: {'created_time': 1777277429.858883, 'last_price_update_time': 1777277429.858898, 'has_photos': True, 'auction_closing_time': 1777391481.0}
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_9b28a4aa286795b59bea95ae691f8256.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6791cdf3-59fd-515b-97e6-02512e00d8c8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_e27407b2b9ac7dbb51dba3dfa76a40d8.jpg not downloaded yet
2026-04-27 08:10:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d6ca001-230b-53fa-862b-40e96406ffa4 with identifier: TK51874
2026-04-27 08:10:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6ca001-230b-53fa-862b-40e96406ffa4 with scrape type 1
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_4f1ce821560b2c22ee63c1036c7be4cf.jpg not downloaded yet
2026-04-27 08:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_78abafcc93d887367e6c7a203549d10b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd with identifier: FW29244
2026-04-27 08:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd with identifier: FW29244
2026-04-27 08:10:30 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd with identifier: FW29244 to the API
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:30 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 154,
'category': 'Rental',
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:45:51Z',
'fuel_type': 'petrol',
'id': '3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW29244',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Renault',
'model': 'Megane',
'odometer': 175700,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_730c82c750240b9b0f236c3ef5536e4d.jpg',
'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_e88aaec179dcf90cbb66bd4736d2c999.jpg',
'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_591e5711aaabd993495ca6a4637b9781.jpg',
'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_7ad11866872700d5b3d179fd12d7d71d.jpg',
'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_8f8e589723d4da616dde522ffd194da2.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_730c82c750240b9b0f236c3ef5536e4d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_591e5711aaabd993495ca6a4637b9781.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84392,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_7ad11866872700d5b3d179fd12d7d71d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd/3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img00/f9/00f9a54676a313f4987b0d567fdfe2b4/pa/FW29244_8f8e589723d4da616dde522ffd194da2.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2010-10-25',
'seats_number': 5,
'seller_name': None,
'title': 'Renault Megane 1.6 Dynamique',
'transmission': 'manual',
'trim': 'Dynamique',
'year': 2010}
2026-04-27 08:10:30 [auto1.it] INFO: Saving data for FW29244: {'created_time': 1777277430.521568, 'last_price_update_time': 1777277430.521581, 'has_photos': True, 'auction_closing_time': 1777391151.0}
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 3446fb3d-6dbb-52c2-b4e3-1dadf074c7cd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_730dde77bc72cd9b51970a99bdd57f3c.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_072c105227c2faca0c34eee27061b352.jpg not downloaded yet
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5250>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_9b28a4aa286795b59bea95ae691f8256.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d10e1346-3ffd-5c97-9037-2f0bf92fef30
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3e150>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_78abafcc93d887367e6c7a203549d10b.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d10e1346-3ffd-5c97-9037-2f0bf92fef30
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_c18050cedc2df7b825acf5b7119cb3c0.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_43e5968e9309e60a7b8bb17a34b49330.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_82153dfc997182a719215893634e3654.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_fc0348ad9fc09c67c7305b4a8fc61663.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e6192eb3e9b555a2a7efbeabe8478532.jpg not downloaded yet
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_a9ad3872f8dddd6e92fc94141a27973e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e9bd89c88621e5a7986581139170721f.jpg not downloaded yet
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_04187660156cff9c6fa0f1813db7a3b9.jpg not downloaded yet
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3d210>
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:30 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_a9ad3872f8dddd6e92fc94141a27973e.jpg saved to cache
2026-04-27 08:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d10e1346-3ffd-5c97-9037-2f0bf92fef30
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_fc0348ad9fc09c67c7305b4a8fc61663.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_04187660156cff9c6fa0f1813db7a3b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6387a90>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_fc0348ad9fc09c67c7305b4a8fc61663.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ca50>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_04187660156cff9c6fa0f1813db7a3b9.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e9bd89c88621e5a7986581139170721f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e6192eb3e9b555a2a7efbeabe8478532.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3f910>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e9bd89c88621e5a7986581139170721f.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5559450>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e6192eb3e9b555a2a7efbeabe8478532.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_82153dfc997182a719215893634e3654.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_43e5968e9309e60a7b8bb17a34b49330.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_c18050cedc2df7b825acf5b7119cb3c0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_730dde77bc72cd9b51970a99bdd57f3c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_072c105227c2faca0c34eee27061b352.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item d10e1346-3ffd-5c97-9037-2f0bf92fef30 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dac10>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_82153dfc997182a719215893634e3654.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_4f1ce821560b2c22ee63c1036c7be4cf.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_e27407b2b9ac7dbb51dba3dfa76a40d8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548d990>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_43e5968e9309e60a7b8bb17a34b49330.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5963a50>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_c18050cedc2df7b825acf5b7119cb3c0.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577a090>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_730dde77bc72cd9b51970a99bdd57f3c.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead725e7d0>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_072c105227c2faca0c34eee27061b352.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664b50>
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_4f1ce821560b2c22ee63c1036c7be4cf.jpg saved to cache
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d6ca001-230b-53fa-862b-40e96406ffa4
2026-04-27 08:10:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d6ca001-230b-53fa-862b-40e96406ffa4, skipping ID generation
2026-04-27 08:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d6ca001-230b-53fa-862b-40e96406ffa4 with scrape type 1
2026-04-27 08:10:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d6ca001-230b-53fa-862b-40e96406ffa4 sending to next pipeline
2026-04-27 08:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2d6ca001-230b-53fa-862b-40e96406ffa4, identifier: TK51874
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5482f50>
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_e27407b2b9ac7dbb51dba3dfa76a40d8.jpg saved to cache
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d10e1346-3ffd-5c97-9037-2f0bf92fef30
2026-04-27 08:10:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d10e1346-3ffd-5c97-9037-2f0bf92fef30, skipping ID generation
2026-04-27 08:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10e1346-3ffd-5c97-9037-2f0bf92fef30 with scrape type 1
2026-04-27 08:10:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d10e1346-3ffd-5c97-9037-2f0bf92fef30 sending to next pipeline
2026-04-27 08:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d10e1346-3ffd-5c97-9037-2f0bf92fef30, identifier: AK30543
2026-04-27 08:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2d6ca001-230b-53fa-862b-40e96406ffa4 with identifier: TK51874
2026-04-27 08:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2d6ca001-230b-53fa-862b-40e96406ffa4 with identifier: TK51874
2026-04-27 08:10:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2d6ca001-230b-53fa-862b-40e96406ffa4 with identifier: TK51874 to the API
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_4f1ce821560b2c22ee63c1036c7be4cf.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'city': 'Capua',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 6D',
'engine': '1.4L',
'engine_horse_power': 180,
'expiration_date': '2026-04-28T15:50:38Z',
'fuel_type': 'petrol',
'id': '2d6ca001-230b-53fa-862b-40e96406ffa4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK51874',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Abarth',
'model': '595',
'odometer': 38579,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60923,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_4f1ce821560b2c22ee63c1036c7be4cf.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_730dde77bc72cd9b51970a99bdd57f3c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63910,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_072c105227c2faca0c34eee27061b352.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54941,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_c18050cedc2df7b825acf5b7119cb3c0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60003,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_43e5968e9309e60a7b8bb17a34b49330.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60060,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_82153dfc997182a719215893634e3654.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_fc0348ad9fc09c67c7305b4a8fc61663.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58413,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e6192eb3e9b555a2a7efbeabe8478532.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58263,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_e9bd89c88621e5a7986581139170721f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2d6ca001-230b-53fa-862b-40e96406ffa4/2d6ca001-230b-53fa-862b-40e96406ffa4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/eb/d8eb82b6ad733e0559074751372a50ba/pa/TK51874_04187660156cff9c6fa0f1813db7a3b9.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2019-10-16',
'seats_number': 4,
'seller_name': None,
'title': 'Abarth 595 1.4 Competizione',
'transmission': 'automatic',
'trim': 'Competizione',
'year': 2019}
2026-04-27 08:10:32 [auto1.it] INFO: Saving data for TK51874: {'created_time': 1777277432.822131, 'last_price_update_time': 1777277432.822142, 'has_photos': True, 'auction_closing_time': 1777391438.0}
2026-04-27 08:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d10e1346-3ffd-5c97-9037-2f0bf92fef30 with identifier: AK30543
2026-04-27 08:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d10e1346-3ffd-5c97-9037-2f0bf92fef30 with identifier: AK30543
2026-04-27 08:10:32 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d10e1346-3ffd-5c97-9037-2f0bf92fef30 with identifier: AK30543 to the API
2026-04-27 08:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:10:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_e27407b2b9ac7dbb51dba3dfa76a40d8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'category': None,
'city': 'Foggia',
'color': 'blue',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.7L',
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:07:45Z',
'fuel_type': 'diesel',
'id': 'd10e1346-3ffd-5c97-9037-2f0bf92fef30',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.4584,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK30543',
'listing': 'auction',
'location': 'IT, Foggia',
'location_confidence': 'geocoded',
'longitude': 15.5519,
'make': 'Opel',
'model': 'Meriva',
'odometer': 334674,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83437,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_9b28a4aa286795b59bea95ae691f8256.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76008,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_78abafcc93d887367e6c7a203549d10b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68557,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_a9ad3872f8dddd6e92fc94141a27973e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d10e1346-3ffd-5c97-9037-2f0bf92fef30/d10e1346-3ffd-5c97-9037-2f0bf92fef30_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64261,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1e/01/1e01a6a054d63f4be25d4c88e0497277/pa/AK30543_e27407b2b9ac7dbb51dba3dfa76a40d8.jpg',
'Width': 800}],
'postal_code': '71100',
'price': 0,
'price_includes_vat': True,
'province': 'Foggia',
'province_code': 'IT-FG',
'region': 'Puglia',
'region_code': 'IT-13',
'registration_date': '2007-07-04',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Meriva 1.7 CDTI Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2007}
2026-04-27 08:10:33 [auto1.it] INFO: Saving data for AK30543: {'created_time': 1777277433.139485, 'last_price_update_time': 1777277433.139496, 'has_photos': True, 'auction_closing_time': 1777388865.0}
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NW55395> (referer: https://www.auto1.com/v1/car-details-view/NW55395/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CF78450> (referer: https://www.auto1.com/v1/car-details-view/CF78450/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TA36593/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96cc671b-1737-51ae-bd47-b19a1abfb219 with identifier: NW55395
2026-04-27 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96cc671b-1737-51ae-bd47-b19a1abfb219 with scrape type 1
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 96cc671b-1737-51ae-bd47-b19a1abfb219
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_97cc2ed269e1d5a28b3848ab094cb46d.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb with identifier: CF78450
2026-04-27 08:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb with scrape type 1
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_87eecb16a32a7c519f8d2846f4c208eb.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_5096d055124972364888d726430a011b.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_feb464c75508ba34ba562995fbcee228.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_6aade9e156161f7c3e0ff0d2276285b6.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_0811ba570d44a73413b4170ad9237a35.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_0b95957f87a6f50f0ca6f23013f3aa52.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_84ea538f4a6941a92fe00e896d5f18c8.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_b4f671ca91819170f700350795a34a19.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_9da8641b5d23c6e68fb8954878d75910.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_46f96339b8c1db16d7a7d1fd95a8bbb5.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_fadbd6d35085aced528677cf6dc4967d.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_ab0b1090f7fac2208ee42f98b697c8df.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_d9a12343a8df9e2123953c498612f8d2.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_d42ed10b5828755861123afc75a5a7c0.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_fc0e9e36ed1add95cd9c1ea7ec0a3f90.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_52c1b4f1f941d8e9e60c3f255662f7d2.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_29419f14f12f906022acca69ef3d49bd.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_5d61b3f786118d93ae07eeffbb9fdd49.jpg not downloaded yet
2026-04-27 08:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_60d42bcaa3da8fdaf4759b3cd2d953b4.jpg not downloaded yet
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF04197/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_60d42bcaa3da8fdaf4759b3cd2d953b4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead533ba10>
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb/6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_60d42bcaa3da8fdaf4759b3cd2d953b4.jpg saved to cache
2026-04-27 08:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK09468/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_5d61b3f786118d93ae07eeffbb9fdd49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621450>
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96cc671b-1737-51ae-bd47-b19a1abfb219/96cc671b-1737-51ae-bd47-b19a1abfb219_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_5d61b3f786118d93ae07eeffbb9fdd49.jpg saved to cache
2026-04-27 08:10:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 96cc671b-1737-51ae-bd47-b19a1abfb219
2026-04-27 08:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_29419f14f12f906022acca69ef3d49bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bad90>
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb/6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img56/74/56740430472fd28d4511b7f8713cd4cf/pa/CF78450_29419f14f12f906022acca69ef3d49bd.jpg saved to cache
2026-04-27 08:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f3b90c8-fda0-5c08-8ebb-b25fe80ab2bb
2026-04-27 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:44 [auto1.it] INFO: Channel: 24h | Page: 11 | totalHits: 3152 | hits on page: 40
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: CY87158
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: YL89014
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for YL89014: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: JH97185
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: BR14904
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for BR14904: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: LP60965
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for LP60965: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: SS01622
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for SS01622: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: FL27850
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for FL27850: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: DZ95846
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for DZ95846: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: JN62828
2026-04-27 08:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_52c1b4f1f941d8e9e60c3f255662f7d2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: BA67590
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: KD52940
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for KD52940: 0
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: KL26738
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for KL26738: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: BH63969
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for BH63969: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: YA89224
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for YA89224: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: EC99785
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for EC99785: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: EK30542
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for EK30542: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: JJ65659
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for JJ65659: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: AN86148
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for AN86148: 1
2026-04-27 08:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c2a10>
2026-04-27 08:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:10:44 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_96cc671b-1737-51ae-bd47-b19a1abfb219/96cc671b-1737-51ae-bd47-b19a1abfb219_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img84/cd/84cd0c622185652718dc5417fbce6d2a/pa/NW55395_52c1b4f1f941d8e9e60c3f255662f7d2.jpg saved to cache
2026-04-27 08:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 96cc671b-1737-51ae-bd47-b19a1abfb219
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: RV63380
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for RV63380: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: ZY39181
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for ZY39181: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: GK84881
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for GK84881: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: DC61267
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for DC61267: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: TC50511
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for TC50511: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: PU05825
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for PU05825: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: MX93098
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for MX93098: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: TF94829
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for TF94829: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: SA92674
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for SA92674: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: BC74314
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for BC74314: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: YW30917
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for YW30917: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: AZ95530
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for AZ95530: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: FV19054
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for FV19054: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: GV81081
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for GV81081: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: KV85142
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for KV85142: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: XT03089
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for XT03089: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: TN43536
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for TN43536: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: UY91565
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for UY91565: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: XA59652
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for XA59652: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: AC71103
2026-04-27 08:10:44 [auto1.it] INFO: Scrape type for AC71103: 1
2026-04-27 08:10:44 [auto1.it] INFO: Found listing with ID: YF20115
2026-04-27 08:10:45 [auto1.it] INFO: Scrape type for YF20115: 1
2026-04-27 08:10:45 [auto1.it] INFO: Found listing with ID: JB69094
2026-04-27 08:10:45 [auto1.it] INFO: Scrape type for JB69094: 1
2026-04-27 08:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FH21751/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:10:46 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.557(s), this was the 1st time calling it.
2026-04-27 08:10:46 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.583865049414744 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BA67590> (referer: https://www.auto1.com/v1/car-details-view/BA67590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: adab85e8-dd4c-5480-b546-d7f73b1b5031 with identifier: BA67590
2026-04-27 08:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adab85e8-dd4c-5480-b546-d7f73b1b5031 with scrape type 1
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_53d479d11f4a8721214cf584ef928517.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c3ffa259d9f5e5a6f46b8108709fb5e6.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_e912f3100d518aea3b4d471b36138670.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_06be0070188bfa9010dde611342b812c.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_2a0a3275b2b81b21940fad993ef76732.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_af9d340343b56b7ab7da40d974ececc9.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c0a553d73e5430b8da7b6750941d04ef.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c6109ae016c59b3391bccead78ab7cad.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_fcef8565a2f70a81488c3d5138f47ab6.jpg not downloaded yet
2026-04-27 08:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_61326f28c69331543f6b4eda216ecbdd.jpg not downloaded yet
2026-04-27 08:11:00 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.357(s), this was the 1st time calling it.
2026-04-27 08:11:00 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.088193260477643 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TF39801/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_61326f28c69331543f6b4eda216ecbdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56650d0>
2026-04-27 08:11:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_61326f28c69331543f6b4eda216ecbdd.jpg saved to cache
2026-04-27 08:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:10 [scrapy.extensions.logstats] INFO: Crawled 611 pages (at 20 pages/min), scraped 265 items (at 11 items/min)
2026-04-27 08:11:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:11:15 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.030(s), this was the 1st time calling it.
2026-04-27 08:11:15 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.078840188328062 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:11:51 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.988(s), this was the 1st time calling it.
2026-04-27 08:11:51 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.500486344959491 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JH97185> (referer: https://www.auto1.com/v1/car-details-view/JH97185/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:11:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:11:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-04-27 08:11:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with scrape type 1
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg not downloaded yet
2026-04-27 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_fcef8565a2f70a81488c3d5138f47ab6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg not downloaded yet
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg not downloaded yet
2026-04-27 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552d790>
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_fcef8565a2f70a81488c3d5138f47ab6.jpg saved to cache
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5490>
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg saved to cache
2026-04-27 08:11:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a297d0>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621190>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a034d0>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e4ad0>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5644750>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f56d0>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a00a10>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0f50>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5924310>
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg saved to cache
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8
2026-04-27 08:11:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8, skipping ID generation
2026-04-27 08:11:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with scrape type 1
2026-04-27 08:11:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 sending to next pipeline
2026-04-27 08:11:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8, identifier: JH97185
2026-04-27 08:11:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-04-27 08:11:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185
2026-04-27 08:11:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: daaa3a0f-e46a-51da-a933-0dc6a86f8dd8 with identifier: JH97185 to the API
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg>
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:19:37Z',
'fuel_type': 'petrol',
'id': 'daaa3a0f-e46a-51da-a933-0dc6a86f8dd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH97185',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Alfa Romeo',
'model': 'Tonale',
'odometer': 54133,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74953,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_694d6dafa2baf25ad09ccf0e4ca72deb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73210,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ccb0f110fea56dcc5c78bf2ab0a27c69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68754,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_ec0169198c9cbc44a1b5d661664fca48.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_1d7047e2934fc693c809c2337e9f3ae8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_bd6a537dfe16635ecddeaee96b5e1dc6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67623,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_146cd9fa7876dfe9b4535d2c69e617fe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_972945a1a35bd6d477c2569182469c9a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60542,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_2ea81aee3b233e4c7db67d19cf41a57d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67453,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_12dcfd0597cafab9cdc4313eef621a52.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_daaa3a0f-e46a-51da-a933-0dc6a86f8dd8/daaa3a0f-e46a-51da-a933-0dc6a86f8dd8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56995,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgff/da/ffda9d5f174ecffe9a00220d2312d0f5/pa/JH97185_7debe2fa3a6bb2a8be58eb1b4c22e709.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2023-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'Alfa Romeo Tonale 1.5 Mild-Hybrid Sprint',
'transmission': 'automatic',
'trim': 'Sprint',
'year': 2023}
2026-04-27 08:11:56 [auto1.it] INFO: Saving data for JH97185: {'created_time': 1777277516.636091, 'last_price_update_time': 1777277516.636106, 'has_photos': True, 'auction_closing_time': 1777389577.0}
2026-04-27 08:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c6109ae016c59b3391bccead78ab7cad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6477b10>
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c6109ae016c59b3391bccead78ab7cad.jpg saved to cache
2026-04-27 08:11:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c0a553d73e5430b8da7b6750941d04ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dae10>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c0a553d73e5430b8da7b6750941d04ef.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_af9d340343b56b7ab7da40d974ececc9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762e90>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_af9d340343b56b7ab7da40d974ececc9.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_2a0a3275b2b81b21940fad993ef76732.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621450>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_2a0a3275b2b81b21940fad993ef76732.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_06be0070188bfa9010dde611342b812c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760110>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_06be0070188bfa9010dde611342b812c.jpg saved to cache
2026-04-27 08:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_e912f3100d518aea3b4d471b36138670.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545add0>
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:57 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_e912f3100d518aea3b4d471b36138670.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c3ffa259d9f5e5a6f46b8108709fb5e6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_53d479d11f4a8721214cf584ef928517.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5817b90>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c3ffa259d9f5e5a6f46b8108709fb5e6.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bbc10>
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:11:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_53d479d11f4a8721214cf584ef928517.jpg saved to cache
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item adab85e8-dd4c-5480-b546-d7f73b1b5031
2026-04-27 08:11:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: adab85e8-dd4c-5480-b546-d7f73b1b5031, skipping ID generation
2026-04-27 08:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item adab85e8-dd4c-5480-b546-d7f73b1b5031 with scrape type 1
2026-04-27 08:11:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item adab85e8-dd4c-5480-b546-d7f73b1b5031 sending to next pipeline
2026-04-27 08:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: adab85e8-dd4c-5480-b546-d7f73b1b5031, identifier: BA67590
2026-04-27 08:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: adab85e8-dd4c-5480-b546-d7f73b1b5031 with identifier: BA67590
2026-04-27 08:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: adab85e8-dd4c-5480-b546-d7f73b1b5031 with identifier: BA67590
2026-04-27 08:11:58 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: adab85e8-dd4c-5480-b546-d7f73b1b5031 with identifier: BA67590 to the API
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:11:58 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_53d479d11f4a8721214cf584ef928517.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Capua',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.2L',
'engine_horse_power': 101,
'expiration_date': '2026-04-28T15:37:04Z',
'fuel_type': 'petrol',
'id': 'adab85e8-dd4c-5480-b546-d7f73b1b5031',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BA67590',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Peugeot',
'model': '208',
'odometer': 74637,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99313,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_53d479d11f4a8721214cf584ef928517.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c3ffa259d9f5e5a6f46b8108709fb5e6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81358,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_e912f3100d518aea3b4d471b36138670.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65625,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_06be0070188bfa9010dde611342b812c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88730,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_2a0a3275b2b81b21940fad993ef76732.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104000,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_af9d340343b56b7ab7da40d974ececc9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65259,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c0a553d73e5430b8da7b6750941d04ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100678,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_c6109ae016c59b3391bccead78ab7cad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92303,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_fcef8565a2f70a81488c3d5138f47ab6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_adab85e8-dd4c-5480-b546-d7f73b1b5031/adab85e8-dd4c-5480-b546-d7f73b1b5031_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67692,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd6/5d/d65d7b17bf84661384a83a50c7ed049c/pa/BA67590_61326f28c69331543f6b4eda216ecbdd.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2021-10-28',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.2 PureTech Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2021}
2026-04-27 08:11:58 [auto1.it] INFO: Saving data for BA67590: {'created_time': 1777277518.87245, 'last_price_update_time': 1777277518.872462, 'has_photos': True, 'auction_closing_time': 1777390624.0}
2026-04-27 08:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JN62828> (referer: https://www.auto1.com/v1/car-details-view/JN62828/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with identifier: JN62828
2026-04-27 08:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with scrape type 1
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76985dac23748cbcd84939a2ec11914f.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76a59b8c2e8d22d049d0d24f62605e65.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_cadac8545914c77a1533409a02c9674a.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_22733c791701be8e1e53b1a9780eca50.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_67f5d2be5e4bd046db5c8e561e884c4c.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_9f6887e3cdd003e8d38e51ffe1d22f6b.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_5e05063b0a619c2bb347fd57c99f9d4a.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_6e02b55130707a546f9b6b0c2929dd2e.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_c8128dae291ab247f3c0a36bad86c240.jpg not downloaded yet
2026-04-27 08:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_95ef45ea92c618df05cf5da59d568c07.jpg not downloaded yet
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH68995/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_95ef45ea92c618df05cf5da59d568c07.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a13d0>
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_95ef45ea92c618df05cf5da59d568c07.jpg saved to cache
2026-04-27 08:12:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF04197> (referer: https://www.auto1.com/v1/car-details-view/UF04197/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_c8128dae291ab247f3c0a36bad86c240.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_6e02b55130707a546f9b6b0c2929dd2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d20822-bb0c-5a74-95e8-7b234d0ab01f with identifier: UF04197
2026-04-27 08:12:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f with scrape type 1
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_05889d800101e4ce7f49839fb017dabd.jpg not downloaded yet
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_382af0603875270845a4c94d0c1e98ef.jpg not downloaded yet
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_b821555cd83b73c9142580ba180ebef5.jpg not downloaded yet
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_66e488820a00f2cd6eb27765de28e08a.jpg not downloaded yet
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_5e05063b0a619c2bb347fd57c99f9d4a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_e64bcf1fb2abd0a57127b6342233ddf8.jpg not downloaded yet
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c4d0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_c8128dae291ab247f3c0a36bad86c240.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ee90>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_6e02b55130707a546f9b6b0c2929dd2e.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_66e488820a00f2cd6eb27765de28e08a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555aed0>
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_5e05063b0a619c2bb347fd57c99f9d4a.jpg saved to cache
2026-04-27 08:12:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_e64bcf1fb2abd0a57127b6342233ddf8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_b821555cd83b73c9142580ba180ebef5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55134d0>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_66e488820a00f2cd6eb27765de28e08a.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594c190>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_e64bcf1fb2abd0a57127b6342233ddf8.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6d90>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_b821555cd83b73c9142580ba180ebef5.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_382af0603875270845a4c94d0c1e98ef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_05889d800101e4ce7f49839fb017dabd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6384150>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_382af0603875270845a4c94d0c1e98ef.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a1250>
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_05889d800101e4ce7f49839fb017dabd.jpg saved to cache
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f
2026-04-27 08:12:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e2d20822-bb0c-5a74-95e8-7b234d0ab01f, skipping ID generation
2026-04-27 08:12:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f with scrape type 1
2026-04-27 08:12:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e2d20822-bb0c-5a74-95e8-7b234d0ab01f sending to next pipeline
2026-04-27 08:12:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: e2d20822-bb0c-5a74-95e8-7b234d0ab01f, identifier: UF04197
2026-04-27 08:12:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: e2d20822-bb0c-5a74-95e8-7b234d0ab01f with identifier: UF04197
2026-04-27 08:12:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: e2d20822-bb0c-5a74-95e8-7b234d0ab01f with identifier: UF04197
2026-04-27 08:12:04 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: e2d20822-bb0c-5a74-95e8-7b234d0ab01f with identifier: UF04197 to the API
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:04 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_05889d800101e4ce7f49839fb017dabd.jpg>
{'auction_title': '',
'c_o_2_emission_value': 173,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '2.2L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:13:20Z',
'fuel_type': 'diesel',
'id': 'e2d20822-bb0c-5a74-95e8-7b234d0ab01f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF04197',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Honda',
'model': 'CR-V',
'odometer': 376533,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84306,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_05889d800101e4ce7f49839fb017dabd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86822,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_382af0603875270845a4c94d0c1e98ef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80107,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_b821555cd83b73c9142580ba180ebef5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 22675,
'Height': 255,
'OriginUrl': 'https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_66e488820a00f2cd6eb27765de28e08a.jpg',
'Width': 340},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_e2d20822-bb0c-5a74-95e8-7b234d0ab01f/e2d20822-bb0c-5a74-95e8-7b234d0ab01f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45355,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img67/87/678737db7d3b1b4c2eb32a28888018a4/pa/UF04197_e64bcf1fb2abd0a57127b6342233ddf8.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2007-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Honda CR-V 2.2 CTDI Executive',
'transmission': 'manual',
'trim': 'Executive',
'year': 2007}
2026-04-27 08:12:05 [auto1.it] INFO: Saving data for UF04197: {'created_time': 1777277525.024176, 'last_price_update_time': 1777277525.024193, 'has_photos': True, 'auction_closing_time': 1777389200.0}
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_9f6887e3cdd003e8d38e51ffe1d22f6b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d01d0>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_9f6887e3cdd003e8d38e51ffe1d22f6b.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_67f5d2be5e4bd046db5c8e561e884c4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b90d0>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_67f5d2be5e4bd046db5c8e561e884c4c.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_22733c791701be8e1e53b1a9780eca50.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567d7d0>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_22733c791701be8e1e53b1a9780eca50.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_cadac8545914c77a1533409a02c9674a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76a59b8c2e8d22d049d0d24f62605e65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76985dac23748cbcd84939a2ec11914f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0990>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_cadac8545914c77a1533409a02c9674a.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6810>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76a59b8c2e8d22d049d0d24f62605e65.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5836790>
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76985dac23748cbcd84939a2ec11914f.jpg saved to cache
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956
2026-04-27 08:12:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bbc55ab7-0d2c-59d3-aee5-abfa06dff956, skipping ID generation
2026-04-27 08:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with scrape type 1
2026-04-27 08:12:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bbc55ab7-0d2c-59d3-aee5-abfa06dff956 sending to next pipeline
2026-04-27 08:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: bbc55ab7-0d2c-59d3-aee5-abfa06dff956, identifier: JN62828
2026-04-27 08:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with identifier: JN62828
2026-04-27 08:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with identifier: JN62828
2026-04-27 08:12:06 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bbc55ab7-0d2c-59d3-aee5-abfa06dff956 with identifier: JN62828 to the API
2026-04-27 08:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:06 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76985dac23748cbcd84939a2ec11914f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'city': 'Reggio Emilia',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.3L',
'engine_horse_power': 136,
'expiration_date': '2026-04-28T15:03:18Z',
'fuel_type': 'petrol',
'id': 'bbc55ab7-0d2c-59d3-aee5-abfa06dff956',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN62828',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Mercedes-Benz',
'model': 'A-Klasse',
'odometer': 203189,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63094,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76985dac23748cbcd84939a2ec11914f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_76a59b8c2e8d22d049d0d24f62605e65.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67803,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_cadac8545914c77a1533409a02c9674a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43387,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_22733c791701be8e1e53b1a9780eca50.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62704,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_67f5d2be5e4bd046db5c8e561e884c4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70007,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_9f6887e3cdd003e8d38e51ffe1d22f6b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54044,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_5e05063b0a619c2bb347fd57c99f9d4a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65788,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_6e02b55130707a546f9b6b0c2929dd2e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75827,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_c8128dae291ab247f3c0a36bad86c240.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bbc55ab7-0d2c-59d3-aee5-abfa06dff956/bbc55ab7-0d2c-59d3-aee5-abfa06dff956_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45538,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img10/e6/10e6fedcf74929f8ade6f4394f6337b5/pa/JN62828_95ef45ea92c618df05cf5da59d568c07.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2020-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
'transmission': 'automatic',
'trim': 'AMG Line',
'year': 2020}
2026-04-27 08:12:06 [auto1.it] INFO: Saving data for JN62828: {'created_time': 1777277526.399983, 'last_price_update_time': 1777277526.399997, 'has_photos': True, 'auction_closing_time': 1777388598.0}
2026-04-27 08:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES64600/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:09 [auto1.it] INFO: Channel: 24h | Page: 12 | totalHits: 3154 | hits on page: 40
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: YF20115
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: JB69094
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: XR95165
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for XR95165: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: UX75954
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for UX75954: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: TF45632
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for TF45632: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: ZF92701
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for ZF92701: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: VL73001
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for VL73001: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: PZ92590
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for PZ92590: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: PJ43507
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for PJ43507: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: UX28393
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for UX28393: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: RF11851
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for RF11851: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: BW07837
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for BW07837: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: NV90062
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for NV90062: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: XW11581
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for XW11581: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: YY28632
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for YY28632: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: ND41368
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for ND41368: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: PW49149
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for PW49149: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: ZT54121
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for ZT54121: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: ZK87486
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for ZK87486: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: BL12748
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for BL12748: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: BA18808
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for BA18808: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: TJ53412
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for TJ53412: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: CH57824
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for CH57824: 1
2026-04-27 08:12:09 [auto1.it] INFO: Found listing with ID: VC63991
2026-04-27 08:12:09 [auto1.it] INFO: Scrape type for VC63991: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: GP15834
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for GP15834: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: YH65644
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for YH65644: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: LE58060
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for LE58060: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: KH33587
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for KH33587: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: LT83663
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for LT83663: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: HJ29626
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for HJ29626: 1
2026-04-27 08:12:10 [scrapy.extensions.logstats] INFO: Crawled 617 pages (at 6 pages/min), scraped 269 items (at 4 items/min)
2026-04-27 08:12:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: VR29883
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for VR29883: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: YK32497
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for YK32497: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: WA05506
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for WA05506: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: NG41904
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for NG41904: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: KW09319
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for KW09319: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: RJ39648
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for RJ39648: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: AR18622
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for AR18622: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: KV98716
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for KV98716: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: KM66214
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for KM66214: 1
2026-04-27 08:12:10 [auto1.it] INFO: Found listing with ID: LC36038
2026-04-27 08:12:10 [auto1.it] INFO: Scrape type for LC36038: 1
2026-04-27 08:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CY87158/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK09468> (referer: https://www.auto1.com/v1/car-details-view/FK09468/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-04-27 08:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with scrape type 1
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_c443ab845127c9545caefe86a42062fb.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6095b218d20e9339f33d31c645db4584.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_ee305baa53361514197d5967d89697ab.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d06a656154ac56a6337fa1075e0ee72c.jpg not downloaded yet
2026-04-27 08:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_20514099cd4f3cb16b043707096f0213.jpg not downloaded yet
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6324892aa18f7a73691d14c796e5dc60.jpg not downloaded yet
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d0a79d74c6b5a71706e7c0dc9c948098.jpg not downloaded yet
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_b95f68ff461e1edc5633ccf5e0f616ce.jpg not downloaded yet
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_953b9e8637818886e786894064d2dfd7.jpg not downloaded yet
2026-04-27 08:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_7072580e72527857c4ffa84ddcd22c6d.jpg not downloaded yet
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FH21751> (referer: https://www.auto1.com/v1/car-details-view/FH21751/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c41cb662-74e7-5cd2-8897-2163da16e769 with identifier: FH21751
2026-04-27 08:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41cb662-74e7-5cd2-8897-2163da16e769 with scrape type 1
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_d1577769161c115cdce222b8cfe114d7.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_cd54adb6c51460c0f4f572e397645453.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_8792edae66334e4f4157bbfc5c0f9c11.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_94a9e7a3062ffe64b31a57697c5a3f73.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_2159c8b3b6144cc8749b6a9765a54db0.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_1d8ba83658967569e83c4f6844d0e82b.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_15b32be42b874f5cb4987637a90e6035.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_acc4fc16a88b7d627bc71c9159e9d54f.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_7c7fd932ebbc76af30c95072ba5d2665.jpg not downloaded yet
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_77c3fc55ec8b08c4c509968e6e89ee10.jpg not downloaded yet
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_7072580e72527857c4ffa84ddcd22c6d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f1890>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_7072580e72527857c4ffa84ddcd22c6d.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_77c3fc55ec8b08c4c509968e6e89ee10.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_7c7fd932ebbc76af30c95072ba5d2665.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_acc4fc16a88b7d627bc71c9159e9d54f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6581750>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_77c3fc55ec8b08c4c509968e6e89ee10.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5960f10>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_7c7fd932ebbc76af30c95072ba5d2665.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563ce90>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_acc4fc16a88b7d627bc71c9159e9d54f.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_15b32be42b874f5cb4987637a90e6035.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5963150>
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_15b32be42b874f5cb4987637a90e6035.jpg saved to cache
2026-04-27 08:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_1d8ba83658967569e83c4f6844d0e82b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YF20115/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621f90>
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_1d8ba83658967569e83c4f6844d0e82b.jpg saved to cache
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_2159c8b3b6144cc8749b6a9765a54db0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_8792edae66334e4f4157bbfc5c0f9c11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65821d0>
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_2159c8b3b6144cc8749b6a9765a54db0.jpg saved to cache
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f4290>
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_8792edae66334e4f4157bbfc5c0f9c11.jpg saved to cache
2026-04-27 08:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_cd54adb6c51460c0f4f572e397645453.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c41cb662-74e7-5cd2-8897-2163da16e769 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_d1577769161c115cdce222b8cfe114d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_953b9e8637818886e786894064d2dfd7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aa8110>
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_cd54adb6c51460c0f4f572e397645453.jpg saved to cache
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5664650>
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_d1577769161c115cdce222b8cfe114d7.jpg saved to cache
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c41cb662-74e7-5cd2-8897-2163da16e769
2026-04-27 08:12:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c41cb662-74e7-5cd2-8897-2163da16e769, skipping ID generation
2026-04-27 08:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c41cb662-74e7-5cd2-8897-2163da16e769 with scrape type 1
2026-04-27 08:12:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c41cb662-74e7-5cd2-8897-2163da16e769 sending to next pipeline
2026-04-27 08:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: c41cb662-74e7-5cd2-8897-2163da16e769, identifier: FH21751
2026-04-27 08:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c41cb662-74e7-5cd2-8897-2163da16e769 with identifier: FH21751
2026-04-27 08:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c41cb662-74e7-5cd2-8897-2163da16e769 with identifier: FH21751
2026-04-27 08:12:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c41cb662-74e7-5cd2-8897-2163da16e769 with identifier: FH21751 to the API
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_d1577769161c115cdce222b8cfe114d7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'city': 'Settimo Torinese',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D-TEMP',
'engine': '2.0L',
'engine_horse_power': 190,
'expiration_date': '2026-04-28T15:30:34Z',
'fuel_type': 'diesel',
'id': 'c41cb662-74e7-5cd2-8897-2163da16e769',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH21751',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Volvo',
'model': 'V60',
'odometer': 192379,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_d1577769161c115cdce222b8cfe114d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59574,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_cd54adb6c51460c0f4f572e397645453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50533,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_8792edae66334e4f4157bbfc5c0f9c11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46380,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_2159c8b3b6144cc8749b6a9765a54db0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55037,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_1d8ba83658967569e83c4f6844d0e82b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44033,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_15b32be42b874f5cb4987637a90e6035.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59883,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_acc4fc16a88b7d627bc71c9159e9d54f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60905,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_7c7fd932ebbc76af30c95072ba5d2665.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c41cb662-74e7-5cd2-8897-2163da16e769/c41cb662-74e7-5cd2-8897-2163da16e769_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50438,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgab/b4/abb416ded534280d0daad24391c2071e/pa/FH21751_77c3fc55ec8b08c4c509968e6e89ee10.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2018-09-03',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo V60 2.0 D4 Business Plus',
'transmission': 'automatic',
'trim': 'Business Plus',
'year': 2018}
2026-04-27 08:12:19 [auto1.it] INFO: Saving data for FH21751: {'created_time': 1777277539.964726, 'last_price_update_time': 1777277539.964738, 'has_photos': True, 'auction_closing_time': 1777390234.0}
2026-04-27 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_b95f68ff461e1edc5633ccf5e0f616ce.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AC71103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58bb3d0>
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_953b9e8637818886e786894064d2dfd7.jpg saved to cache
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5815ed0>
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_b95f68ff461e1edc5633ccf5e0f616ce.jpg saved to cache
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d0a79d74c6b5a71706e7c0dc9c948098.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5512850>
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:20 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d0a79d74c6b5a71706e7c0dc9c948098.jpg saved to cache
2026-04-27 08:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_20514099cd4f3cb16b043707096f0213.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6385d10>
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_20514099cd4f3cb16b043707096f0213.jpg saved to cache
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d06a656154ac56a6337fa1075e0ee72c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c3a50>
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d06a656154ac56a6337fa1075e0ee72c.jpg saved to cache
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_ee305baa53361514197d5967d89697ab.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JB69094/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6095b218d20e9339f33d31c645db4584.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5498e10>
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_ee305baa53361514197d5967d89697ab.jpg saved to cache
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547f150>
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6095b218d20e9339f33d31c645db4584.jpg saved to cache
2026-04-27 08:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88
2026-04-27 08:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TF39801> (referer: https://www.auto1.com/v1/car-details-view/TF39801/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with identifier: TF39801
2026-04-27 08:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with scrape type 1
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_3ccccb3b2c1916fe857a868bfff70b24.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_e4427edaf9c59d1692c9c6b21d35c832.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_c996a9070d20234425995eef5524b373.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9c07d77d517b7b8dcd583cd1b5c93829.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_cd3db7302508cbb66ea7e05595e27bc7.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_76d6960ca0b7bde8e96e253bab869ddb.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_2139db1e7c97432485d3275a1e08628d.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9aad8944c7c20d4102499befc0ff01c6.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_5d3af2e063738bae7ecf4a25113fafe6.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_70d9b1d41a7516d1ad6819836e45aeaa.jpg not downloaded yet
2026-04-27 08:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-04-27 08:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468
2026-04-27 08:12:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 4d5b3f9f-29c0-5841-8171-4c47b151ee88 with identifier: FK09468 to the API
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:23 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 115,
'category': None,
'city': 'Roma',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 95,
'expiration_date': '2026-04-28T15:57:23Z',
'fuel_type': 'diesel',
'id': '4d5b3f9f-29c0-5841-8171-4c47b151ee88',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK09468',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Jeep',
'model': 'Renegade',
'odometer': 105561,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_c443ab845127c9545caefe86a42062fb.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6095b218d20e9339f33d31c645db4584.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_ee305baa53361514197d5967d89697ab.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d06a656154ac56a6337fa1075e0ee72c.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_20514099cd4f3cb16b043707096f0213.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6324892aa18f7a73691d14c796e5dc60.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d0a79d74c6b5a71706e7c0dc9c948098.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_b95f68ff461e1edc5633ccf5e0f616ce.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_953b9e8637818886e786894064d2dfd7.jpg',
'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_7072580e72527857c4ffa84ddcd22c6d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100490,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_6095b218d20e9339f33d31c645db4584.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75449,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_ee305baa53361514197d5967d89697ab.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63042,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d06a656154ac56a6337fa1075e0ee72c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84943,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_20514099cd4f3cb16b043707096f0213.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75141,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_d0a79d74c6b5a71706e7c0dc9c948098.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_b95f68ff461e1edc5633ccf5e0f616ce.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98090,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_953b9e8637818886e786894064d2dfd7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_4d5b3f9f-29c0-5841-8171-4c47b151ee88/4d5b3f9f-29c0-5841-8171-4c47b151ee88_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82243,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd5/96/d596d04822fb040b0871a85eaa1bf1ff/pa/FK09468_7072580e72527857c4ffa84ddcd22c6d.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2018-07-30',
'seats_number': 5,
'seller_name': None,
'title': 'Jeep Renegade 1.6 M-Jet Sport FWD',
'transmission': 'manual',
'trim': 'Sport FWD',
'year': 2018}
2026-04-27 08:12:23 [auto1.it] INFO: Saving data for FK09468: {'created_time': 1777277543.236088, 'last_price_update_time': 1777277543.236103, 'has_photos': True, 'auction_closing_time': 1777391843.0}
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4d5b3f9f-29c0-5841-8171-4c47b151ee88 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_70d9b1d41a7516d1ad6819836e45aeaa.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5936ed0>
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_70d9b1d41a7516d1ad6819836e45aeaa.jpg saved to cache
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_5d3af2e063738bae7ecf4a25113fafe6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548ccd0>
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_5d3af2e063738bae7ecf4a25113fafe6.jpg saved to cache
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9aad8944c7c20d4102499befc0ff01c6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927c10>
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9aad8944c7c20d4102499befc0ff01c6.jpg saved to cache
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_2139db1e7c97432485d3275a1e08628d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_76d6960ca0b7bde8e96e253bab869ddb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667c90>
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_2139db1e7c97432485d3275a1e08628d.jpg saved to cache
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552f750>
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_76d6960ca0b7bde8e96e253bab869ddb.jpg saved to cache
2026-04-27 08:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_cd3db7302508cbb66ea7e05595e27bc7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547c890>
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_cd3db7302508cbb66ea7e05595e27bc7.jpg saved to cache
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9c07d77d517b7b8dcd583cd1b5c93829.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5926c10>
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9c07d77d517b7b8dcd583cd1b5c93829.jpg saved to cache
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_c996a9070d20234425995eef5524b373.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59da890>
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_c996a9070d20234425995eef5524b373.jpg saved to cache
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_e4427edaf9c59d1692c9c6b21d35c832.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_3ccccb3b2c1916fe857a868bfff70b24.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5962690>
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_e4427edaf9c59d1692c9c6b21d35c832.jpg saved to cache
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5934750>
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_3ccccb3b2c1916fe857a868bfff70b24.jpg saved to cache
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5
2026-04-27 08:12:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5, skipping ID generation
2026-04-27 08:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with scrape type 1
2026-04-27 08:12:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 sending to next pipeline
2026-04-27 08:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5, identifier: TF39801
2026-04-27 08:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with identifier: TF39801
2026-04-27 08:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with identifier: TF39801
2026-04-27 08:12:24 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5 with identifier: TF39801 to the API
2026-04-27 08:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_3ccccb3b2c1916fe857a868bfff70b24.jpg>
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Reggio Emilia',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.6L',
'engine_horse_power': 100,
'expiration_date': '2026-04-28T15:59:35Z',
'fuel_type': 'diesel',
'id': '1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF39801',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Citroen',
'model': 'Berlingo',
'odometer': 173705,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_3ccccb3b2c1916fe857a868bfff70b24.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64736,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_e4427edaf9c59d1692c9c6b21d35c832.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62142,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_c996a9070d20234425995eef5524b373.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49783,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9c07d77d517b7b8dcd583cd1b5c93829.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51703,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_cd3db7302508cbb66ea7e05595e27bc7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61150,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_76d6960ca0b7bde8e96e253bab869ddb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_2139db1e7c97432485d3275a1e08628d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67575,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_9aad8944c7c20d4102499befc0ff01c6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60327,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_5d3af2e063738bae7ecf4a25113fafe6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5/1d9232fa-4b0c-5cbb-a8a0-2b241bf506f5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80492,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga4/7b/a47b46185abe75558e218a32a6ad8eff/pa/TF39801_70d9b1d41a7516d1ad6819836e45aeaa.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2018-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen Berlingo 1.6 Blue-HDi Feel',
'transmission': 'manual',
'trim': 'Feel',
'year': 2018}
2026-04-27 08:12:25 [auto1.it] INFO: Saving data for TF39801: {'created_time': 1777277545.197895, 'last_price_update_time': 1777277545.197904, 'has_photos': True, 'auction_closing_time': 1777391975.0}
2026-04-27 08:12:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XA59652/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES64600> (referer: https://www.auto1.com/v1/car-details-view/ES64600/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 114e7e81-16a8-578b-ae37-b36b09015f32 with identifier: ES64600
2026-04-27 08:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 114e7e81-16a8-578b-ae37-b36b09015f32 with scrape type 1
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_275bad19d3b8ea884c19fcd11d5fdc62.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_8def5a369b717d93634b411bea23d9b5.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_c5ad446639ad9f766d1ac4a865cf4383.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_91db815674d5ce19b0428f3bfe918536.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_dd168ef5d74eea55f169e74b32c27406.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_566e0e2ec15c973dc2b961a9338b8eef.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_cf86633bbfd1424279d3b0153b549a11.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_2448eacb243523de17e8ab31f44c451b.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_08b7da76eece0767826728b98c486592.jpg not downloaded yet
2026-04-27 08:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_e44ed6aecab5cdd67e64033c283a1437.jpg not downloaded yet
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YC78141/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_e44ed6aecab5cdd67e64033c283a1437.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582610>
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:29 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_e44ed6aecab5cdd67e64033c283a1437.jpg saved to cache
2026-04-27 08:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UY91565/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_08b7da76eece0767826728b98c486592.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dfc50>
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_08b7da76eece0767826728b98c486592.jpg saved to cache
2026-04-27 08:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YF20115> (referer: https://www.auto1.com/v1/car-details-view/YF20115/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_2448eacb243523de17e8ab31f44c451b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f45dfcf0-995d-5064-aa79-9fd920fb2983 with identifier: YF20115
2026-04-27 08:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f45dfcf0-995d-5064-aa79-9fd920fb2983 with scrape type 1
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f45dfcf0-995d-5064-aa79-9fd920fb2983
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_e1af82dca21946e5ad453e54dd75636b.jpg not downloaded yet
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_aaac846676377f01bbc53f68e81dbd34.jpg not downloaded yet
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_9b884421ed46ce4389c79ceaff52d70d.jpg not downloaded yet
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_0fc8eb28b691cafea7ac1174d418eefe.jpg not downloaded yet
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_7ce4ff29e1256f6d824f254bfee4f564.jpg not downloaded yet
2026-04-27 08:12:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5667a50>
2026-04-27 08:12:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_2448eacb243523de17e8ab31f44c451b.jpg saved to cache
2026-04-27 08:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_cf86633bbfd1424279d3b0153b549a11.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_7ce4ff29e1256f6d824f254bfee4f564.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_0fc8eb28b691cafea7ac1174d418eefe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d12d0>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_cf86633bbfd1424279d3b0153b549a11.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_9b884421ed46ce4389c79ceaff52d70d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CY87158> (referer: https://www.auto1.com/v1/car-details-view/CY87158/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563f590>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_7ce4ff29e1256f6d824f254bfee4f564.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f45dfcf0-995d-5064-aa79-9fd920fb2983
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_aaac846676377f01bbc53f68e81dbd34.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5816710>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_0fc8eb28b691cafea7ac1174d418eefe.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f45dfcf0-995d-5064-aa79-9fd920fb2983
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b9c10>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_9b884421ed46ce4389c79ceaff52d70d.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f45dfcf0-995d-5064-aa79-9fd920fb2983
2026-04-27 08:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 with identifier: CY87158
2026-04-27 08:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 with scrape type 1
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_8d1fb4b5d61364ace9df228039fc8955.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_0f94c497e8da037b821c38656cb7b56c.jpg not downloaded yet
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a94d90>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_aaac846676377f01bbc53f68e81dbd34.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f45dfcf0-995d-5064-aa79-9fd920fb2983
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_d886c67703fee7e07512aa8633cb8aa2.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_5a92df26a60b332495210940b3fce142.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_401e40f54bb4fe7340963b930680dbb9.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_9c7d3b697f018dccf8b430b97f5e2174.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_b38f09e9e07118a4e79fa201c71b973d.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_3a4c54764be459cb5edb775301663606.jpg not downloaded yet
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_7912d34d426aadf0d8620a9cdc4dcf73.jpg not downloaded yet
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_566e0e2ec15c973dc2b961a9338b8eef.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_bfef091490c3e8a2ace867fa3d77e8b9.jpg not downloaded yet
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_7912d34d426aadf0d8620a9cdc4dcf73.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58bbb10>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_566e0e2ec15c973dc2b961a9338b8eef.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6583690>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_7912d34d426aadf0d8620a9cdc4dcf73.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_bfef091490c3e8a2ace867fa3d77e8b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a3ec90>
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_bfef091490c3e8a2ace867fa3d77e8b9.jpg saved to cache
2026-04-27 08:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_3a4c54764be459cb5edb775301663606.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c1bd0>
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_3a4c54764be459cb5edb775301663606.jpg saved to cache
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_b38f09e9e07118a4e79fa201c71b973d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64873d0>
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_b38f09e9e07118a4e79fa201c71b973d.jpg saved to cache
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f45dfcf0-995d-5064-aa79-9fd920fb2983 with identifier: YF20115
2026-04-27 08:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f45dfcf0-995d-5064-aa79-9fd920fb2983 with identifier: YF20115
2026-04-27 08:12:37 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f45dfcf0-995d-5064-aa79-9fd920fb2983 with identifier: YF20115 to the API
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:37 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Senago',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:41:59Z',
'fuel_type': 'petrol',
'id': 'f45dfcf0-995d-5064-aa79-9fd920fb2983',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5756,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF20115',
'listing': 'auction',
'location': 'IT, Senago (MI)',
'location_confidence': 'geocoded',
'longitude': 9.1262,
'make': 'Peugeot',
'model': '208',
'odometer': 157300,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_e1af82dca21946e5ad453e54dd75636b.jpg',
'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_aaac846676377f01bbc53f68e81dbd34.jpg',
'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_9b884421ed46ce4389c79ceaff52d70d.jpg',
'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_0fc8eb28b691cafea7ac1174d418eefe.jpg',
'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_7ce4ff29e1256f6d824f254bfee4f564.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64937,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_aaac846676377f01bbc53f68e81dbd34.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57718,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_9b884421ed46ce4389c79ceaff52d70d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49100,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_0fc8eb28b691cafea7ac1174d418eefe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f45dfcf0-995d-5064-aa79-9fd920fb2983/f45dfcf0-995d-5064-aa79-9fd920fb2983_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45502,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img94/45/94455d5d4d289a971f2da4f3ccb950fb/pa/YF20115_7ce4ff29e1256f6d824f254bfee4f564.jpg',
'Width': 800}],
'postal_code': '20030',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2012-06-30',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2012}
2026-04-27 08:12:37 [auto1.it] INFO: Saving data for YF20115: {'created_time': 1777277557.839684, 'last_price_update_time': 1777277557.839697, 'has_photos': True, 'auction_closing_time': 1777390919.0}
2026-04-27 08:12:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item f45dfcf0-995d-5064-aa79-9fd920fb2983 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_9c7d3b697f018dccf8b430b97f5e2174.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4acbad0>
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:37 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_9c7d3b697f018dccf8b430b97f5e2174.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_5a92df26a60b332495210940b3fce142.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59dbbd0>
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_5a92df26a60b332495210940b3fce142.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_d886c67703fee7e07512aa8633cb8aa2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_8d1fb4b5d61364ace9df228039fc8955.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551d710>
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_d886c67703fee7e07512aa8633cb8aa2.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5926f10>
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_8d1fb4b5d61364ace9df228039fc8955.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_dd168ef5d74eea55f169e74b32c27406.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c0a90>
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_dd168ef5d74eea55f169e74b32c27406.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_91db815674d5ce19b0428f3bfe918536.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564d190>
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:38 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_91db815674d5ce19b0428f3bfe918536.jpg saved to cache
2026-04-27 08:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_c5ad446639ad9f766d1ac4a865cf4383.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LC36038/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a009d0>
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_c5ad446639ad9f766d1ac4a865cf4383.jpg saved to cache
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_8def5a369b717d93634b411bea23d9b5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6582710>
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_8def5a369b717d93634b411bea23d9b5.jpg saved to cache
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 114e7e81-16a8-578b-ae37-b36b09015f32
2026-04-27 08:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 with identifier: CY87158
2026-04-27 08:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 with identifier: CY87158
2026-04-27 08:12:39 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 with identifier: CY87158 to the API
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:39 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:39 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 105,
'category': None,
'city': 'Roma',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:26:23Z',
'fuel_type': 'diesel',
'id': 'b84bf910-fe16-5fe8-84c4-ef5b32adfdd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CY87158',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Ford',
'model': 'C-Max',
'odometer': 222764,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_8d1fb4b5d61364ace9df228039fc8955.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_0f94c497e8da037b821c38656cb7b56c.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_d886c67703fee7e07512aa8633cb8aa2.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_5a92df26a60b332495210940b3fce142.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_401e40f54bb4fe7340963b930680dbb9.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_9c7d3b697f018dccf8b430b97f5e2174.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_b38f09e9e07118a4e79fa201c71b973d.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_3a4c54764be459cb5edb775301663606.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_7912d34d426aadf0d8620a9cdc4dcf73.jpg',
'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_bfef091490c3e8a2ace867fa3d77e8b9.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 123961,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_8d1fb4b5d61364ace9df228039fc8955.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108569,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_d886c67703fee7e07512aa8633cb8aa2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_5a92df26a60b332495210940b3fce142.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 109756,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_9c7d3b697f018dccf8b430b97f5e2174.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96140,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_b38f09e9e07118a4e79fa201c71b973d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113530,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_3a4c54764be459cb5edb775301663606.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111187,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_7912d34d426aadf0d8620a9cdc4dcf73.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_b84bf910-fe16-5fe8-84c4-ef5b32adfdd3/b84bf910-fe16-5fe8-84c4-ef5b32adfdd3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90811,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb0/77/b077e847e2a40da0e0a9c253607ea303/pa/CY87158_bfef091490c3e8a2ace867fa3d77e8b9.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2017-06-29',
'seats_number': 5,
'seller_name': None,
'title': 'Ford C-Max 1.5 TDCi Plus',
'transmission': 'manual',
'trim': 'Plus',
'year': 2017}
2026-04-27 08:12:39 [auto1.it] INFO: Saving data for CY87158: {'created_time': 1777277559.851181, 'last_price_update_time': 1777277559.851191, 'has_photos': True, 'auction_closing_time': 1777389983.0}
2026-04-27 08:12:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b84bf910-fe16-5fe8-84c4-ef5b32adfdd3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 114e7e81-16a8-578b-ae37-b36b09015f32 with identifier: ES64600
2026-04-27 08:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 114e7e81-16a8-578b-ae37-b36b09015f32 with identifier: ES64600
2026-04-27 08:12:40 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 114e7e81-16a8-578b-ae37-b36b09015f32 with identifier: ES64600 to the API
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:40 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:40 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 113,
'category': None,
'city': 'Milazzo',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 69,
'expiration_date': '2026-04-28T15:03:54Z',
'fuel_type': 'petrol',
'id': '114e7e81-16a8-578b-ae37-b36b09015f32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES64600',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Fiat',
'model': 'Panda',
'odometer': 41403,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_275bad19d3b8ea884c19fcd11d5fdc62.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_8def5a369b717d93634b411bea23d9b5.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_c5ad446639ad9f766d1ac4a865cf4383.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_91db815674d5ce19b0428f3bfe918536.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_dd168ef5d74eea55f169e74b32c27406.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_566e0e2ec15c973dc2b961a9338b8eef.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_cf86633bbfd1424279d3b0153b549a11.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_2448eacb243523de17e8ab31f44c451b.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_08b7da76eece0767826728b98c486592.jpg',
'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_e44ed6aecab5cdd67e64033c283a1437.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92554,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_8def5a369b717d93634b411bea23d9b5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96166,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_c5ad446639ad9f766d1ac4a865cf4383.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74484,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_91db815674d5ce19b0428f3bfe918536.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85824,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_dd168ef5d74eea55f169e74b32c27406.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91018,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_566e0e2ec15c973dc2b961a9338b8eef.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60385,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_cf86633bbfd1424279d3b0153b549a11.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99851,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_2448eacb243523de17e8ab31f44c451b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84423,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_08b7da76eece0767826728b98c486592.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_114e7e81-16a8-578b-ae37-b36b09015f32/114e7e81-16a8-578b-ae37-b36b09015f32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96531,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img83/ab/83abd87f08c121a166e5ce4a4c343aa3/pa/ES64600_e44ed6aecab5cdd67e64033c283a1437.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2024-08-29',
'seats_number': 4,
'seller_name': None,
'title': 'Fiat Panda 1.0 Mild-Hybrid',
'transmission': 'manual',
'trim': '',
'year': 2024}
2026-04-27 08:12:40 [auto1.it] INFO: Saving data for ES64600: {'created_time': 1777277560.535227, 'last_price_update_time': 1777277560.535238, 'has_photos': True, 'auction_closing_time': 1777388634.0}
2026-04-27 08:12:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 114e7e81-16a8-578b-ae37-b36b09015f32 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.921(s), this was the 1st time calling it.
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 7.398626268511691 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KM66214/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AC71103> (referer: https://www.auto1.com/v1/car-details-view/AC71103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42df9558-968c-5650-a4eb-11a033bde7d5 with identifier: AC71103
2026-04-27 08:12:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42df9558-968c-5650-a4eb-11a033bde7d5 with scrape type 1
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_40a52eb810c00048629a65f0a91264e4.jpg not downloaded yet
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_fe556b608bc13568748679768e1d1ee5.jpg not downloaded yet
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_664b88a4bb82193f870ffa66af6cd252.jpg not downloaded yet
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_9e8a86694eaf039a41311eb80898703a.jpg not downloaded yet
2026-04-27 08:12:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_44b33e5d9dfe4de32ecf77eecae57179.jpg not downloaded yet
2026-04-27 08:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JB69094> (referer: https://www.auto1.com/v1/car-details-view/JB69094/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_44b33e5d9dfe4de32ecf77eecae57179.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 588ee80b-a238-527f-b292-078bb00c7bef with identifier: JB69094
2026-04-27 08:12:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 588ee80b-a238-527f-b292-078bb00c7bef with scrape type 1
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_7c5414bd363c5178708869548fdfc4b6.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_0ffda9935ff05b5832fa7cd79bd94039.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d6e3609956325a00a2ee44d4d2e332e9.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_b5cf21d968bd3ffbc83bbc7e3ecc1cc1.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_8864cd50b0fd6b962a97ee5da0478dd1.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_52c7deb07fcefd879f2aeaef452ee223.jpg not downloaded yet
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b17d0>
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_44b33e5d9dfe4de32ecf77eecae57179.jpg saved to cache
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_8366bfdbb168982cfbae57a997e37c42.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d48eefc8c760d629598c4d06fc65e91c.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d7f954ed90837e41d1b064949a37efd3.jpg not downloaded yet
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_76f8129835324477bbfeaacb01d27bda.jpg not downloaded yet
2026-04-27 08:12:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_9e8a86694eaf039a41311eb80898703a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545a3d0>
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:46 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_9e8a86694eaf039a41311eb80898703a.jpg saved to cache
2026-04-27 08:12:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_76f8129835324477bbfeaacb01d27bda.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d7f954ed90837e41d1b064949a37efd3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5622350>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_76f8129835324477bbfeaacb01d27bda.jpg saved to cache
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5760510>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d7f954ed90837e41d1b064949a37efd3.jpg saved to cache
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.422(s), this was the 1st time calling it.
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.278013301742303 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AR18622/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d48eefc8c760d629598c4d06fc65e91c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5762190>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d48eefc8c760d629598c4d06fc65e91c.jpg saved to cache
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_52c7deb07fcefd879f2aeaef452ee223.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52790>
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_52c7deb07fcefd879f2aeaef452ee223.jpg saved to cache
2026-04-27 08:12:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 588ee80b-a238-527f-b292-078bb00c7bef due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_8864cd50b0fd6b962a97ee5da0478dd1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f51d0>
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_8864cd50b0fd6b962a97ee5da0478dd1.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_b5cf21d968bd3ffbc83bbc7e3ecc1cc1.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f4e50>
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:48 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_b5cf21d968bd3ffbc83bbc7e3ecc1cc1.jpg saved to cache
2026-04-27 08:12:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d6e3609956325a00a2ee44d4d2e332e9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_0ffda9935ff05b5832fa7cd79bd94039.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_7c5414bd363c5178708869548fdfc4b6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5934b50>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d6e3609956325a00a2ee44d4d2e332e9.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_664b88a4bb82193f870ffa66af6cd252.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486e10>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_0ffda9935ff05b5832fa7cd79bd94039.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_fe556b608bc13568748679768e1d1ee5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5480890>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_7c5414bd363c5178708869548fdfc4b6.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 588ee80b-a238-527f-b292-078bb00c7bef
2026-04-27 08:12:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 588ee80b-a238-527f-b292-078bb00c7bef, skipping ID generation
2026-04-27 08:12:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 588ee80b-a238-527f-b292-078bb00c7bef with scrape type 1
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 588ee80b-a238-527f-b292-078bb00c7bef sending to next pipeline
2026-04-27 08:12:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 588ee80b-a238-527f-b292-078bb00c7bef, identifier: JB69094
2026-04-27 08:12:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 588ee80b-a238-527f-b292-078bb00c7bef with identifier: JB69094
2026-04-27 08:12:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 588ee80b-a238-527f-b292-078bb00c7bef with identifier: JB69094
2026-04-27 08:12:49 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 588ee80b-a238-527f-b292-078bb00c7bef with identifier: JB69094 to the API
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_7c5414bd363c5178708869548fdfc4b6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'category': None,
'city': 'Milazzo',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:35:58Z',
'fuel_type': 'diesel',
'id': '588ee80b-a238-527f-b292-078bb00c7bef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 38.2201,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JB69094',
'listing': 'auction',
'location': 'IT, Milazzo',
'location_confidence': 'geocoded',
'longitude': 15.2402,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 219144,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80384,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_7c5414bd363c5178708869548fdfc4b6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_0ffda9935ff05b5832fa7cd79bd94039.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68128,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d6e3609956325a00a2ee44d4d2e332e9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62212,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_b5cf21d968bd3ffbc83bbc7e3ecc1cc1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68213,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_8864cd50b0fd6b962a97ee5da0478dd1.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69539,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_52c7deb07fcefd879f2aeaef452ee223.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77880,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d48eefc8c760d629598c4d06fc65e91c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75862,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_d7f954ed90837e41d1b064949a37efd3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_588ee80b-a238-527f-b292-078bb00c7bef/588ee80b-a238-527f-b292-078bb00c7bef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82819,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img06/e3/06e30c3bb6a115e68b0d9083aef774fc/pa/JB69094_76f8129835324477bbfeaacb01d27bda.jpg',
'Width': 800}],
'postal_code': '98057',
'price': 0,
'price_includes_vat': True,
'province': 'Messina',
'province_code': 'IT-ME',
'region': 'Sicilia',
'region_code': 'IT-15',
'registration_date': '2017-02-20',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Business BlueMotion Tech',
'transmission': 'manual',
'trim': 'Business BlueMotion Tech',
'year': 2017}
2026-04-27 08:12:49 [auto1.it] INFO: Saving data for JB69094: {'created_time': 1777277569.901234, 'last_price_update_time': 1777277569.901247, 'has_photos': True, 'auction_closing_time': 1777390558.0}
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YC78141> (referer: https://www.auto1.com/v1/car-details-view/YC78141/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae518b390>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_664b88a4bb82193f870ffa66af6cd252.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57afcd0>
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:49 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_fe556b608bc13568748679768e1d1ee5.jpg saved to cache
2026-04-27 08:12:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_40a52eb810c00048629a65f0a91264e4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0aae9e1-ea27-5f88-990e-b427d2d342a4 with identifier: YC78141
2026-04-27 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0aae9e1-ea27-5f88-990e-b427d2d342a4 with scrape type 1
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_31741df8c937b5a641791a1603cde271.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_dbfdcff23607096a45bce91df9d4f885.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_049de9760341edb892da6b2a528d1221.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bb89025f1663a68edba870c3682b5f24.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_2cc70b163c3426a90e5d2f72c3185ecd.jpg not downloaded yet
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f0750>
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_40a52eb810c00048629a65f0a91264e4.jpg saved to cache
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 42df9558-968c-5650-a4eb-11a033bde7d5
2026-04-27 08:12:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 42df9558-968c-5650-a4eb-11a033bde7d5, skipping ID generation
2026-04-27 08:12:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42df9558-968c-5650-a4eb-11a033bde7d5 with scrape type 1
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 42df9558-968c-5650-a4eb-11a033bde7d5 sending to next pipeline
2026-04-27 08:12:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 42df9558-968c-5650-a4eb-11a033bde7d5, identifier: AC71103
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_97d175ca5402acc0e800fab3f06c4f97.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 42df9558-968c-5650-a4eb-11a033bde7d5 with identifier: AC71103
2026-04-27 08:12:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 42df9558-968c-5650-a4eb-11a033bde7d5 with identifier: AC71103
2026-04-27 08:12:50 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 42df9558-968c-5650-a4eb-11a033bde7d5 with identifier: AC71103 to the API
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:50 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_40a52eb810c00048629a65f0a91264e4.jpg>
{'auction_title': '',
'c_o_2_emission_value': 153,
'category': None,
'city': 'Capannori',
'color': 'black',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 4',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:31:18Z',
'fuel_type': 'diesel',
'id': '42df9558-968c-5650-a4eb-11a033bde7d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AC71103',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Volkswagen',
'model': 'Passat',
'odometer': 182661,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74188,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_40a52eb810c00048629a65f0a91264e4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75258,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_fe556b608bc13568748679768e1d1ee5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84663,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_664b88a4bb82193f870ffa66af6cd252.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77846,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_9e8a86694eaf039a41311eb80898703a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_42df9558-968c-5650-a4eb-11a033bde7d5/42df9558-968c-5650-a4eb-11a033bde7d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85310,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img82/89/8289114dfc066844ac8ae754bf1cea3d/pa/AC71103_44b33e5d9dfe4de32ecf77eecae57179.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2008-05-06',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Passat 2.0 TDI Highline',
'transmission': 'manual',
'trim': 'Highline',
'year': 2008}
2026-04-27 08:12:50 [auto1.it] INFO: Saving data for AC71103: {'created_time': 1777277570.656483, 'last_price_update_time': 1777277570.656492, 'has_photos': True, 'auction_closing_time': 1777390278.0}
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_64bcb79a7b5cc257671bf1bad5f8e2ee.jpg not downloaded yet
2026-04-27 08:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bbeeda576f3af994b09c46813de8c894.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_6cc45d9cc4a720582a26c4099f02ccfe.jpg not downloaded yet
2026-04-27 08:12:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_73cefca5c0d2d96fd792813c525f3e3b.jpg not downloaded yet
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UY91565> (referer: https://www.auto1.com/v1/car-details-view/UY91565/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_73cefca5c0d2d96fd792813c525f3e3b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd9f7db4-1b63-5dc1-89b5-10626eff35eb with identifier: UY91565
2026-04-27 08:12:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb with scrape type 1
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_dae28477acaac0e0709bda6367a26e72.jpg not downloaded yet
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_c914aadc19683f0ede96d0e440950fec.jpg not downloaded yet
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_6cc45d9cc4a720582a26c4099f02ccfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_e3ab680dd1eaed70b239ce589a71cf1f.jpg not downloaded yet
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY06096/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_ad5af8dd55a8633322ca8aad438cf260.jpg not downloaded yet
2026-04-27 08:12:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_2c0e87dd796710ab2bde28ca0a27c55e.jpg not downloaded yet
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_dae28477acaac0e0709bda6367a26e72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555ab50>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_73cefca5c0d2d96fd792813c525f3e3b.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c70d0>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_6cc45d9cc4a720582a26c4099f02ccfe.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a942d0>
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_dae28477acaac0e0709bda6367a26e72.jpg saved to cache
2026-04-27 08:12:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb
2026-04-27 08:12:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_2c0e87dd796710ab2bde28ca0a27c55e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5abba50>
2026-04-27 08:12:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_2c0e87dd796710ab2bde28ca0a27c55e.jpg saved to cache
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb
2026-04-27 08:12:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:12:52 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_ad5af8dd55a8633322ca8aad438cf260.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5785e90>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_ad5af8dd55a8633322ca8aad438cf260.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_c914aadc19683f0ede96d0e440950fec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bbeeda576f3af994b09c46813de8c894.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_64bcb79a7b5cc257671bf1bad5f8e2ee.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b8d10>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_c914aadc19683f0ede96d0e440950fec.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb
2026-04-27 08:12:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd9f7db4-1b63-5dc1-89b5-10626eff35eb, skipping ID generation
2026-04-27 08:12:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb with scrape type 1
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd9f7db4-1b63-5dc1-89b5-10626eff35eb sending to next pipeline
2026-04-27 08:12:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: fd9f7db4-1b63-5dc1-89b5-10626eff35eb, identifier: UY91565
2026-04-27 08:12:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: fd9f7db4-1b63-5dc1-89b5-10626eff35eb with identifier: UY91565
2026-04-27 08:12:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: fd9f7db4-1b63-5dc1-89b5-10626eff35eb with identifier: UY91565
2026-04-27 08:12:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: fd9f7db4-1b63-5dc1-89b5-10626eff35eb with identifier: UY91565 to the API
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_c914aadc19683f0ede96d0e440950fec.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Roma',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.7L',
'engine_horse_power': 110,
'expiration_date': '2026-04-28T15:23:17Z',
'fuel_type': 'diesel',
'id': 'fd9f7db4-1b63-5dc1-89b5-10626eff35eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UY91565',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Opel',
'model': 'Astra',
'odometer': 194600,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 121198,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_dae28477acaac0e0709bda6367a26e72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122344,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_c914aadc19683f0ede96d0e440950fec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_ad5af8dd55a8633322ca8aad438cf260.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_fd9f7db4-1b63-5dc1-89b5-10626eff35eb/fd9f7db4-1b63-5dc1-89b5-10626eff35eb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64865,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8a/43/8a43a3eb0ad455e88a505550522436cf/pa/UY91565_2c0e87dd796710ab2bde28ca0a27c55e.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2011-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Astra 1.7 CDTI Cosmo',
'transmission': 'manual',
'trim': 'Cosmo',
'year': 2011}
2026-04-27 08:12:53 [auto1.it] INFO: Saving data for UY91565: {'created_time': 1777277573.846738, 'last_price_update_time': 1777277573.846749, 'has_photos': True, 'auction_closing_time': 1777389797.0}
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KV98716/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_97d175ca5402acc0e800fab3f06c4f97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567c990>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bbeeda576f3af994b09c46813de8c894.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5936110>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_64bcb79a7b5cc257671bf1bad5f8e2ee.jpg saved to cache
2026-04-27 08:12:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH68995> (referer: https://www.auto1.com/v1/car-details-view/LH68995/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5623810>
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_97d175ca5402acc0e800fab3f06c4f97.jpg saved to cache
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_2cc70b163c3426a90e5d2f72c3185ecd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd13c3cb-19b5-5003-802c-16da7ac25529 with identifier: LH68995
2026-04-27 08:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd13c3cb-19b5-5003-802c-16da7ac25529 with scrape type 1
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b1eedad1155f2b69ec195d1f11597aac.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_f07aff8be163262e7e656c1a47f24895.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_6c992272d9b7b38ede049c47ac4b163a.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_328df371ff6f2fca6d61737de72a072e.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_74031746c111bcc89fa36ea57ca8361c.jpg not downloaded yet
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5483450>
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_2cc70b163c3426a90e5d2f72c3185ecd.jpg saved to cache
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_0123cdcd330fe29f793c257c80a744a2.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_66f31bea07885a8af328df4b53c2ca49.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b9d23fbc5593b342342f20530022c796.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_decd6451f91e77a45ba10c39ddd23770.jpg not downloaded yet
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_442a75d63cfa0e78fdeb809cec3cd6d6.jpg not downloaded yet
2026-04-27 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TR00137/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_442a75d63cfa0e78fdeb809cec3cd6d6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63f2350>
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_442a75d63cfa0e78fdeb809cec3cd6d6.jpg saved to cache
2026-04-27 08:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_decd6451f91e77a45ba10c39ddd23770.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ce10>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_decd6451f91e77a45ba10c39ddd23770.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_66f31bea07885a8af328df4b53c2ca49.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 131.120(s), this was the 1st time calling it.
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.685191293380887 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 129.927(s), this was the 1st time calling it.
2026-04-27 08:12:55 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.852980373576138 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b0a10>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_66f31bea07885a8af328df4b53c2ca49.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_0123cdcd330fe29f793c257c80a744a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5336150>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_0123cdcd330fe29f793c257c80a744a2.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_74031746c111bcc89fa36ea57ca8361c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594ed50>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_74031746c111bcc89fa36ea57ca8361c.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_328df371ff6f2fca6d61737de72a072e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57781d0>
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_328df371ff6f2fca6d61737de72a072e.jpg saved to cache
2026-04-27 08:12:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_6c992272d9b7b38ede049c47ac4b163a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KW09319/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:12:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b1eedad1155f2b69ec195d1f11597aac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item cd13c3cb-19b5-5003-802c-16da7ac25529 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_31741df8c937b5a641791a1603cde271.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead63875d0>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_6c992272d9b7b38ede049c47ac4b163a.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6581750>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b1eedad1155f2b69ec195d1f11597aac.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cd13c3cb-19b5-5003-802c-16da7ac25529
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f6610>
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:12:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:12:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_31741df8c937b5a641791a1603cde271.jpg saved to cache
2026-04-27 08:12:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4
2026-04-27 08:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: cd13c3cb-19b5-5003-802c-16da7ac25529 with identifier: LH68995
2026-04-27 08:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: cd13c3cb-19b5-5003-802c-16da7ac25529 with identifier: LH68995
2026-04-27 08:12:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: cd13c3cb-19b5-5003-802c-16da7ac25529 with identifier: LH68995 to the API
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 131,
'category': None,
'city': 'Capannori',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 116,
'expiration_date': '2026-04-28T15:36:24Z',
'fuel_type': 'diesel',
'id': 'cd13c3cb-19b5-5003-802c-16da7ac25529',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH68995',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Ford',
'model': 'Focus',
'odometer': 54252,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b1eedad1155f2b69ec195d1f11597aac.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_f07aff8be163262e7e656c1a47f24895.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_6c992272d9b7b38ede049c47ac4b163a.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_328df371ff6f2fca6d61737de72a072e.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_74031746c111bcc89fa36ea57ca8361c.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_0123cdcd330fe29f793c257c80a744a2.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_66f31bea07885a8af328df4b53c2ca49.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b9d23fbc5593b342342f20530022c796.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_decd6451f91e77a45ba10c39ddd23770.jpg',
'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_442a75d63cfa0e78fdeb809cec3cd6d6.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62302,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_b1eedad1155f2b69ec195d1f11597aac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69952,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_6c992272d9b7b38ede049c47ac4b163a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_328df371ff6f2fca6d61737de72a072e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59671,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_74031746c111bcc89fa36ea57ca8361c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52357,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_0123cdcd330fe29f793c257c80a744a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52089,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_66f31bea07885a8af328df4b53c2ca49.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_decd6451f91e77a45ba10c39ddd23770.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_cd13c3cb-19b5-5003-802c-16da7ac25529/cd13c3cb-19b5-5003-802c-16da7ac25529_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50884,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img5e/76/5e7605fe6c26499917f98ab2dde4640b/pa/LH68995_442a75d63cfa0e78fdeb809cec3cd6d6.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2023-07-13',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Focus 1.5 TDCi EcoBlue ST-Line X',
'transmission': 'automatic',
'trim': 'ST-Line X',
'year': 2023}
2026-04-27 08:12:57 [auto1.it] INFO: Saving data for LH68995: {'created_time': 1777277577.590889, 'last_price_update_time': 1777277577.5909, 'has_photos': True, 'auction_closing_time': 1777390584.0}
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item cd13c3cb-19b5-5003-802c-16da7ac25529 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:12:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: c0aae9e1-ea27-5f88-990e-b427d2d342a4 with identifier: YC78141
2026-04-27 08:12:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: c0aae9e1-ea27-5f88-990e-b427d2d342a4 with identifier: YC78141
2026-04-27 08:12:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:12:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: c0aae9e1-ea27-5f88-990e-b427d2d342a4 with identifier: YC78141 to the API
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:12:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:12:57 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 167,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:55:50Z',
'fuel_type': 'diesel',
'id': 'c0aae9e1-ea27-5f88-990e-b427d2d342a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YC78141',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Volkswagen',
'model': 'Tiguan',
'odometer': 188598,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 13,
'photo_urls': ['https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_31741df8c937b5a641791a1603cde271.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_dbfdcff23607096a45bce91df9d4f885.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_049de9760341edb892da6b2a528d1221.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bb89025f1663a68edba870c3682b5f24.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_2cc70b163c3426a90e5d2f72c3185ecd.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_97d175ca5402acc0e800fab3f06c4f97.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_64bcb79a7b5cc257671bf1bad5f8e2ee.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bbeeda576f3af994b09c46813de8c894.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_6cc45d9cc4a720582a26c4099f02ccfe.jpg',
'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_73cefca5c0d2d96fd792813c525f3e3b.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171248,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_31741df8c937b5a641791a1603cde271.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151377,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_2cc70b163c3426a90e5d2f72c3185ecd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 132409,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_97d175ca5402acc0e800fab3f06c4f97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 146918,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_64bcb79a7b5cc257671bf1bad5f8e2ee.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151903,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_bbeeda576f3af994b09c46813de8c894.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 116965,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_6cc45d9cc4a720582a26c4099f02ccfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_c0aae9e1-ea27-5f88-990e-b427d2d342a4/c0aae9e1-ea27-5f88-990e-b427d2d342a4_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99526,
'Height': 534,
'OriginUrl': 'https://img-pa.auto1.com/img01/d8/01d8338b482ba7fd135e97193efbb179/pa/YC78141_73cefca5c0d2d96fd792813c525f3e3b.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2012-03-22',
'seats_number': 5,
'seller_name': None,
'title': 'Volkswagen Tiguan 2.0 TDI Sport & Style 4Motion',
'transmission': 'automatic',
'trim': 'Sport & Style 4Motion',
'year': 2012}
2026-04-27 08:12:57 [auto1.it] INFO: Saving data for YC78141: {'created_time': 1777277577.936681, 'last_price_update_time': 1777277577.936694, 'has_photos': True, 'auction_closing_time': 1777391750.0}
2026-04-27 08:12:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item c0aae9e1-ea27-5f88-990e-b427d2d342a4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:13:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KD87590/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HZ95408/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WA05506/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG41904/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LC36038> (referer: https://www.auto1.com/v1/car-details-view/LC36038/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-04-27 08:13:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with scrape type 1
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_2a15a5a64c533123725b40fe908e8e53.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_b89e446bbc37a26d922fe148b854901f.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_5ab122846989e8bcb4b6590828cd0d15.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_cfb8408eb095b8c87ba29eef9ed6550c.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_7f339f1b1d4ca2f9c38f0eff8caaa034.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_aab0a74e9ba0666a0a7d13cf44f50f2c.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_75111f3603047959635c23ac22d2539e.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_a1e08e5d619d0561976d433a5d86df63.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_d8aa7c503d151e610e5103357e11c524.jpg not downloaded yet
2026-04-27 08:13:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_522e196130c832adbcde426e3661ff2e.jpg not downloaded yet
2026-04-27 08:13:10 [scrapy.extensions.logstats] INFO: Crawled 647 pages (at 30 pages/min), scraped 280 items (at 11 items/min)
2026-04-27 08:13:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KV98716> (referer: https://www.auto1.com/v1/car-details-view/KV98716/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dde36b2b-176b-5c0a-b171-d019361b9215 with identifier: KV98716
2026-04-27 08:13:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde36b2b-176b-5c0a-b171-d019361b9215 with scrape type 1
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_83bc19ac681e3dee1f70919f0b068304.jpg not downloaded yet
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_c0589e3dcbae8b479c9fb802fcd10e8d.jpg not downloaded yet
2026-04-27 08:13:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_522e196130c832adbcde426e3661ff2e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4d369988f1d5dbbeee024c2ea7a1844a.jpg not downloaded yet
2026-04-27 08:13:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_28a4392e7057a99838e6ae4f386b695d.jpg not downloaded yet
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_679505eb4b4c90a7179fffa2c75debf8.jpg not downloaded yet
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_1e5e69c75615abaa689f05d4ae1f1031.jpg not downloaded yet
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_6a2e0131dac79ef865ba971274ae04b9.jpg not downloaded yet
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4cd617daed47956e7ee30de31c785df5.jpg not downloaded yet
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_7e138c13eb60c985c4c89a52b5c11208.jpg not downloaded yet
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead552e910>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_522e196130c832adbcde426e3661ff2e.jpg saved to cache
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_00a73f00d438bf470a7c3b73924fbc7c.jpg not downloaded yet
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_c0589e3dcbae8b479c9fb802fcd10e8d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547ea90>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_c0589e3dcbae8b479c9fb802fcd10e8d.jpg saved to cache
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_00a73f00d438bf470a7c3b73924fbc7c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_7e138c13eb60c985c4c89a52b5c11208.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f2550>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_00a73f00d438bf470a7c3b73924fbc7c.jpg saved to cache
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a97f90>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_7e138c13eb60c985c4c89a52b5c11208.jpg saved to cache
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4cd617daed47956e7ee30de31c785df5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_6a2e0131dac79ef865ba971274ae04b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a270d0>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4cd617daed47956e7ee30de31c785df5.jpg saved to cache
2026-04-27 08:13:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR29883/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e3d0>
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:11 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_6a2e0131dac79ef865ba971274ae04b9.jpg saved to cache
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_1e5e69c75615abaa689f05d4ae1f1031.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927850>
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:12 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_1e5e69c75615abaa689f05d4ae1f1031.jpg saved to cache
2026-04-27 08:13:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item dde36b2b-176b-5c0a-b171-d019361b9215 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_28a4392e7057a99838e6ae4f386b695d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6484b10>
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_28a4392e7057a99838e6ae4f386b695d.jpg saved to cache
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4d369988f1d5dbbeee024c2ea7a1844a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5836fd0>
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4d369988f1d5dbbeee024c2ea7a1844a.jpg saved to cache
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_83bc19ac681e3dee1f70919f0b068304.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bb2d0>
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_83bc19ac681e3dee1f70919f0b068304.jpg saved to cache
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dde36b2b-176b-5c0a-b171-d019361b9215
2026-04-27 08:13:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dde36b2b-176b-5c0a-b171-d019361b9215, skipping ID generation
2026-04-27 08:13:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dde36b2b-176b-5c0a-b171-d019361b9215 with scrape type 1
2026-04-27 08:13:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dde36b2b-176b-5c0a-b171-d019361b9215 sending to next pipeline
2026-04-27 08:13:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: dde36b2b-176b-5c0a-b171-d019361b9215, identifier: KV98716
2026-04-27 08:13:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: dde36b2b-176b-5c0a-b171-d019361b9215 with identifier: KV98716
2026-04-27 08:13:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: dde36b2b-176b-5c0a-b171-d019361b9215 with identifier: KV98716
2026-04-27 08:13:13 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: dde36b2b-176b-5c0a-b171-d019361b9215 with identifier: KV98716 to the API
2026-04-27 08:13:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_83bc19ac681e3dee1f70919f0b068304.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'category': None,
'city': None,
'color': 'green',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.6L',
'engine_horse_power': 105,
'expiration_date': '2026-04-28T15:51:41Z',
'fuel_type': 'petrol',
'id': 'dde36b2b-176b-5c0a-b171-d019361b9215',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KV98716',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Seat',
'model': 'Ibiza',
'odometer': 226811,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5271291,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_83bc19ac681e3dee1f70919f0b068304.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5271291,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_c0589e3dcbae8b479c9fb802fcd10e8d.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4833341,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4d369988f1d5dbbeee024c2ea7a1844a.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3195949,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_28a4392e7057a99838e6ae4f386b695d.jpg',
'Width': 3487},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 5359648,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_1e5e69c75615abaa689f05d4ae1f1031.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 4666693,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_6a2e0131dac79ef865ba971274ae04b9.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 122576,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_4cd617daed47956e7ee30de31c785df5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3773866,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_7e138c13eb60c985c4c89a52b5c11208.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_dde36b2b-176b-5c0a-b171-d019361b9215/dde36b2b-176b-5c0a-b171-d019361b9215_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3292494,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img07/6e/076e1cfd4502ae4b7ff81b18128ccfc5/pa/KV98716_00a73f00d438bf470a7c3b73924fbc7c.jpg',
'Width': 4032}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2008-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'Seat Ibiza 1.6 Sport',
'transmission': 'manual',
'trim': 'Sport',
'year': 2008}
2026-04-27 08:13:14 [auto1.it] INFO: Saving data for KV98716: {'created_time': 1777277594.250442, 'last_price_update_time': 1777277594.250459, 'has_photos': True, 'auction_closing_time': 1777391501.0}
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_d8aa7c503d151e610e5103357e11c524.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5926890>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_d8aa7c503d151e610e5103357e11c524.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_a1e08e5d619d0561976d433a5d86df63.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4de5890>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_a1e08e5d619d0561976d433a5d86df63.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_75111f3603047959635c23ac22d2539e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_aab0a74e9ba0666a0a7d13cf44f50f2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486550>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_75111f3603047959635c23ac22d2539e.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576ae50>
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:14 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_aab0a74e9ba0666a0a7d13cf44f50f2c.jpg saved to cache
2026-04-27 08:13:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_7f339f1b1d4ca2f9c38f0eff8caaa034.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59be550>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_7f339f1b1d4ca2f9c38f0eff8caaa034.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_cfb8408eb095b8c87ba29eef9ed6550c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927d10>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_cfb8408eb095b8c87ba29eef9ed6550c.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KW09319> (referer: https://www.auto1.com/v1/car-details-view/KW09319/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_5ab122846989e8bcb4b6590828cd0d15.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_2a15a5a64c533123725b40fe908e8e53.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12c3a106-847d-53c9-924e-c6a606f5179a with identifier: KW09319
2026-04-27 08:13:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12c3a106-847d-53c9-924e-c6a606f5179a with scrape type 1
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_3a4fcc0dd172d7bc1ced660eddfcf321.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_cd9c8b44002764c7bbd6d738eb3d734e.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_fe908c3ac51f813244bab519350fdade.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_39cbf03a51d3a551d93144996558522f.jpg not downloaded yet
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f1a50>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_5ab122846989e8bcb4b6590828cd0d15.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_246fd30f62eb1cb87fcaad3fb7e4d456.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_97fde22652fb299cda679c22b99d22f3.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_501c9082bf1f31660a999070c1202bc3.jpg not downloaded yet
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6c50>
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:15 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_2a15a5a64c533123725b40fe908e8e53.jpg saved to cache
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_d3e699020eff2c384fad40e092feb305.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_92e295c5cf57902a17e01df843cf7f91.jpg not downloaded yet
2026-04-27 08:13:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_41ced1f20a369ce5806ef43658a71688.jpg not downloaded yet
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KM66214> (referer: https://www.auto1.com/v1/car-details-view/KM66214/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9af2562-54f6-5f6c-b539-a9d906b62b15 with identifier: KM66214
2026-04-27 08:13:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9af2562-54f6-5f6c-b539-a9d906b62b15 with scrape type 1
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_96f3e0a1568dc2e609ec7c7c5f5aaccc.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_1cc899edb1fadfd84883be2a94ff7dca.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_73e297d7c9070a1529287f802c796eb4.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_254e3e7fe89fcb8f80172c44ac8cfbdd.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_3ce7e1b69dd5ea9f2908005992d41349.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_a2b84e753fa45db612caf4460a76b400.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c86f18345e07e2ceffaee0d5f34dbfad.jpg not downloaded yet
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_41ced1f20a369ce5806ef43658a71688.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_4377720bd55dde65d8a3abcd60defa2b.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_9ce8c7af9c344f90c7ec7ab20707d910.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c388e01dfb1081e54a3e7ca37f3cf381.jpg not downloaded yet
2026-04-27 08:13:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-04-27 08:13:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038
2026-04-27 08:13:16 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 with identifier: LC36038 to the API
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:16 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 99,
'category': None,
'city': 'Capannori',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.4L',
'engine_horse_power': 68,
'expiration_date': '2026-04-28T15:32:10Z',
'fuel_type': 'diesel',
'id': '9f25b8bf-64cb-5f71-bb29-5299685e3fe1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 43.8417,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LC36038',
'listing': 'auction',
'location': 'IT, Capannori (LU)',
'location_confidence': 'geocoded',
'longitude': 10.5727,
'make': 'Citroen',
'model': 'DS3',
'odometer': 181900,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_2a15a5a64c533123725b40fe908e8e53.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_b89e446bbc37a26d922fe148b854901f.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_5ab122846989e8bcb4b6590828cd0d15.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_cfb8408eb095b8c87ba29eef9ed6550c.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_7f339f1b1d4ca2f9c38f0eff8caaa034.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_aab0a74e9ba0666a0a7d13cf44f50f2c.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_75111f3603047959635c23ac22d2539e.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_a1e08e5d619d0561976d433a5d86df63.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_d8aa7c503d151e610e5103357e11c524.jpg',
'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_522e196130c832adbcde426e3661ff2e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71969,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_2a15a5a64c533123725b40fe908e8e53.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62879,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_5ab122846989e8bcb4b6590828cd0d15.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58599,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_cfb8408eb095b8c87ba29eef9ed6550c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56378,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_7f339f1b1d4ca2f9c38f0eff8caaa034.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62695,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_aab0a74e9ba0666a0a7d13cf44f50f2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57933,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_75111f3603047959635c23ac22d2539e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66927,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_a1e08e5d619d0561976d433a5d86df63.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65785,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_d8aa7c503d151e610e5103357e11c524.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9f25b8bf-64cb-5f71-bb29-5299685e3fe1/9f25b8bf-64cb-5f71-bb29-5299685e3fe1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62450,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img9d/10/9d100fba4d8ddf8bbe2765aa1de10836/pa/LC36038_522e196130c832adbcde426e3661ff2e.jpg',
'Width': 800}],
'postal_code': '55012',
'price': 0,
'price_includes_vat': True,
'province': 'Lucca',
'province_code': 'IT-LU',
'region': 'Toscana',
'region_code': 'IT-16',
'registration_date': '2014-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'Citroen DS3 1.4 HDi SoChic',
'transmission': 'manual',
'trim': 'SoChic',
'year': 2014}
2026-04-27 08:13:16 [auto1.it] INFO: Saving data for LC36038: {'created_time': 1777277596.81262, 'last_price_update_time': 1777277596.812632, 'has_photos': True, 'auction_closing_time': 1777390330.0}
2026-04-27 08:13:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c86f18345e07e2ceffaee0d5f34dbfad.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 9f25b8bf-64cb-5f71-bb29-5299685e3fe1 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5778390>
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_41ced1f20a369ce5806ef43658a71688.jpg saved to cache
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead577b010>
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:16 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c86f18345e07e2ceffaee0d5f34dbfad.jpg saved to cache
2026-04-27 08:13:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c388e01dfb1081e54a3e7ca37f3cf381.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LT83663/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56d5890>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c388e01dfb1081e54a3e7ca37f3cf381.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_9ce8c7af9c344f90c7ec7ab20707d910.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5814550>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_9ce8c7af9c344f90c7ec7ab20707d910.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item d9af2562-54f6-5f6c-b539-a9d906b62b15 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_a2b84e753fa45db612caf4460a76b400.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_254e3e7fe89fcb8f80172c44ac8cfbdd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6386d10>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_a2b84e753fa45db612caf4460a76b400.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead594e290>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_254e3e7fe89fcb8f80172c44ac8cfbdd.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_73e297d7c9070a1529287f802c796eb4.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dde90>
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:17 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_73e297d7c9070a1529287f802c796eb4.jpg saved to cache
2026-04-27 08:13:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_1cc899edb1fadfd84883be2a94ff7dca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_96f3e0a1568dc2e609ec7c7c5f5aaccc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bb310>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_1cc899edb1fadfd84883be2a94ff7dca.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6e50>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_96f3e0a1568dc2e609ec7c7c5f5aaccc.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d9af2562-54f6-5f6c-b539-a9d906b62b15
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_92e295c5cf57902a17e01df843cf7f91.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d9af2562-54f6-5f6c-b539-a9d906b62b15 with identifier: KM66214
2026-04-27 08:13:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d9af2562-54f6-5f6c-b539-a9d906b62b15 with identifier: KM66214
2026-04-27 08:13:18 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d9af2562-54f6-5f6c-b539-a9d906b62b15 with identifier: KM66214 to the API
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:18 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 124,
'category': None,
'city': 'Capua',
'color': 'red',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.7L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:39:35Z',
'fuel_type': 'diesel',
'id': 'd9af2562-54f6-5f6c-b539-a9d906b62b15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM66214',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Kia',
'model': 'Sportage',
'odometer': 86288,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_96f3e0a1568dc2e609ec7c7c5f5aaccc.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_1cc899edb1fadfd84883be2a94ff7dca.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_73e297d7c9070a1529287f802c796eb4.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_254e3e7fe89fcb8f80172c44ac8cfbdd.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_3ce7e1b69dd5ea9f2908005992d41349.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_a2b84e753fa45db612caf4460a76b400.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c86f18345e07e2ceffaee0d5f34dbfad.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_4377720bd55dde65d8a3abcd60defa2b.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_9ce8c7af9c344f90c7ec7ab20707d910.jpg',
'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c388e01dfb1081e54a3e7ca37f3cf381.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_96f3e0a1568dc2e609ec7c7c5f5aaccc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64834,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_1cc899edb1fadfd84883be2a94ff7dca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70805,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_73e297d7c9070a1529287f802c796eb4.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60722,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_254e3e7fe89fcb8f80172c44ac8cfbdd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59398,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_a2b84e753fa45db612caf4460a76b400.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43151,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c86f18345e07e2ceffaee0d5f34dbfad.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66255,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_9ce8c7af9c344f90c7ec7ab20707d910.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d9af2562-54f6-5f6c-b539-a9d906b62b15/d9af2562-54f6-5f6c-b539-a9d906b62b15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58564,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgd8/75/d8758919da3ee00037d8f07802253c19/pa/KM66214_c388e01dfb1081e54a3e7ca37f3cf381.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2016-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'Kia Sportage 1.7 CRDi Class 2WD',
'transmission': 'manual',
'trim': 'Class 2WD',
'year': 2016}
2026-04-27 08:13:18 [auto1.it] INFO: Saving data for KM66214: {'created_time': 1777277598.523737, 'last_price_update_time': 1777277598.523754, 'has_photos': True, 'auction_closing_time': 1777390775.0}
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_501c9082bf1f31660a999070c1202bc3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item d9af2562-54f6-5f6c-b539-a9d906b62b15 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6a10>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_92e295c5cf57902a17e01df843cf7f91.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_97fde22652fb299cda679c22b99d22f3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_246fd30f62eb1cb87fcaad3fb7e4d456.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53ba450>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_501c9082bf1f31660a999070c1202bc3.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55a3010>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_97fde22652fb299cda679c22b99d22f3.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5816dd0>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_246fd30f62eb1cb87fcaad3fb7e4d456.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_39cbf03a51d3a551d93144996558522f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563db10>
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:18 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_39cbf03a51d3a551d93144996558522f.jpg saved to cache
2026-04-27 08:13:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_fe908c3ac51f813244bab519350fdade.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_cd9c8b44002764c7bbd6d738eb3d734e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_3a4fcc0dd172d7bc1ced660eddfcf321.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a50e90>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_fe908c3ac51f813244bab519350fdade.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927950>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_cd9c8b44002764c7bbd6d738eb3d734e.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5927490>
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_3a4fcc0dd172d7bc1ced660eddfcf321.jpg saved to cache
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12c3a106-847d-53c9-924e-c6a606f5179a
2026-04-27 08:13:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 12c3a106-847d-53c9-924e-c6a606f5179a with identifier: KW09319
2026-04-27 08:13:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 12c3a106-847d-53c9-924e-c6a606f5179a with identifier: KW09319
2026-04-27 08:13:19 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 12c3a106-847d-53c9-924e-c6a606f5179a with identifier: KW09319 to the API
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:19 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 50,
'category': None,
'city': 'Padova',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 261,
'expiration_date': '2026-04-28T15:07:39Z',
'fuel_type': 'hybrid',
'id': '12c3a106-847d-53c9-924e-c6a606f5179a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KW09319',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Volvo',
'model': 'XC40',
'odometer': 55672,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_3a4fcc0dd172d7bc1ced660eddfcf321.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_cd9c8b44002764c7bbd6d738eb3d734e.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_fe908c3ac51f813244bab519350fdade.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_39cbf03a51d3a551d93144996558522f.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_246fd30f62eb1cb87fcaad3fb7e4d456.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_97fde22652fb299cda679c22b99d22f3.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_501c9082bf1f31660a999070c1202bc3.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_d3e699020eff2c384fad40e092feb305.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_92e295c5cf57902a17e01df843cf7f91.jpg',
'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_41ced1f20a369ce5806ef43658a71688.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_3a4fcc0dd172d7bc1ced660eddfcf321.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51021,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_cd9c8b44002764c7bbd6d738eb3d734e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55057,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_fe908c3ac51f813244bab519350fdade.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37713,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_39cbf03a51d3a551d93144996558522f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54279,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_246fd30f62eb1cb87fcaad3fb7e4d456.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55832,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_97fde22652fb299cda679c22b99d22f3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53543,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_501c9082bf1f31660a999070c1202bc3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54268,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_92e295c5cf57902a17e01df843cf7f91.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_12c3a106-847d-53c9-924e-c6a606f5179a/12c3a106-847d-53c9-924e-c6a606f5179a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54373,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img30/c0/30c0e18415022176032272c10aadcc20/pa/KW09319_41ced1f20a369ce5806ef43658a71688.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2021-09-30',
'seats_number': 5,
'seller_name': None,
'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid R-Design 2WD',
'transmission': 'automatic',
'trim': 'R-Design 2WD',
'year': 2021}
2026-04-27 08:13:19 [auto1.it] INFO: Saving data for KW09319: {'created_time': 1777277599.595096, 'last_price_update_time': 1777277599.595114, 'has_photos': True, 'auction_closing_time': 1777388859.0}
2026-04-27 08:13:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 12c3a106-847d-53c9-924e-c6a606f5179a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HJ29626/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HZ95408> (referer: https://www.auto1.com/v1/car-details-view/HZ95408/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-04-27 08:13:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb6042fe-d933-5d26-ac1a-04138888742a with scrape type 1
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_f1393154346b126fe4a9daf16b6695a3.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_3d8575c3b950211c7bfae3257fa588d3.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e822642dfca77b884f058a5b8cc3bf8e.jpg not downloaded yet
2026-04-27 08:13:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_9954406b45e79c063b3ae20a59df4032.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_74d64331d8ffa29ac9b9e13ef0cf4f47.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_134e68187c1a5d1be1c2e620b8315685.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_d72744bb6546bc510c618d2349a7290b.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_630629a3c8d07e178ccbc012a781d8e7.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_566bb675e95dd315ef4db871dfecf452.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e598020c08f6c0f4021a37602508c46d.jpg not downloaded yet
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KD87590> (referer: https://www.auto1.com/v1/car-details-view/KD87590/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-04-27 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68a44fbf-633a-5696-a4d4-d3398573fc86 with scrape type 1
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 68a44fbf-633a-5696-a4d4-d3398573fc86
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_fac0ebdf5b443184d50711df4116952a.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_0ddf67ab6981c94d45b0c9c0f67d6ae7.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_301646244ee2c1fc4eeb4b7b4f8690f5.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f581cc3d705f6583a7807d8eaa78fbdc.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f3d68ce601cbfa81cf7e63783222c4bc.jpg not downloaded yet
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e598020c08f6c0f4021a37602508c46d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dee90>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e598020c08f6c0f4021a37602508c46d.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f3d68ce601cbfa81cf7e63783222c4bc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WA05506> (referer: https://www.auto1.com/v1/car-details-view/WA05506/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f581cc3d705f6583a7807d8eaa78fbdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563cf90>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f3d68ce601cbfa81cf7e63783222c4bc.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 68a44fbf-633a-5696-a4d4-d3398573fc86
2026-04-27 08:13:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-04-27 08:13:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 1
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg not downloaded yet
2026-04-27 08:13:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_0ddf67ab6981c94d45b0c9c0f67d6ae7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg not downloaded yet
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg not downloaded yet
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aaa550>
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:21 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f581cc3d705f6583a7807d8eaa78fbdc.jpg saved to cache
2026-04-27 08:13:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 68a44fbf-633a-5696-a4d4-d3398573fc86
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg not downloaded yet
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg not downloaded yet
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5559450>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_0ddf67ab6981c94d45b0c9c0f67d6ae7.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 68a44fbf-633a-5696-a4d4-d3398573fc86
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c4050>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f6a90>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b9c90>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_fac0ebdf5b443184d50711df4116952a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953090>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5814210>
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg saved to cache
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d9c297f-ad9d-5faf-b514-c63740f12274
2026-04-27 08:13:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d9c297f-ad9d-5faf-b514-c63740f12274, skipping ID generation
2026-04-27 08:13:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d9c297f-ad9d-5faf-b514-c63740f12274 with scrape type 1
2026-04-27 08:13:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d9c297f-ad9d-5faf-b514-c63740f12274 sending to next pipeline
2026-04-27 08:13:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 0d9c297f-ad9d-5faf-b514-c63740f12274, identifier: WA05506
2026-04-27 08:13:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-04-27 08:13:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506
2026-04-27 08:13:22 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d9c297f-ad9d-5faf-b514-c63740f12274 with identifier: WA05506 to the API
2026-04-27 08:13:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg>
{'auction_title': '',
'c_o_2_emission_value': 104,
'category': None,
'city': 'Milano',
'color': 'black',
'currency': 'EUR',
'doors_number': 2,
'emission_standard': 'EURO 4',
'engine': '1.0L',
'engine_horse_power': 70,
'expiration_date': '2026-04-28T15:09:27Z',
'fuel_type': 'petrol',
'id': '0d9c297f-ad9d-5faf-b514-c63740f12274',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WA05506',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Smart',
'model': 'fortwo',
'odometer': 154433,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101652,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_0e9586516a5b94ffc889ccc8a9c4473e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112475,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_f47652049c8d37cf37977d1a9ec0bb25.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89694,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_fa941e6bda5226faae6600b8ee0dd592.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87560,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_28a5ebbd5f6f47c8bb5fa8d0b887c798.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d9c297f-ad9d-5faf-b514-c63740f12274/0d9c297f-ad9d-5faf-b514-c63740f12274_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52038,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdd/7c/dd7c761b1f331ce08fb2bd0a4206ace4/pa/WA05506_e803b5b959e84cc2d317653a0a5a1a97.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2008-11-25',
'seats_number': 2,
'seller_name': None,
'title': 'Smart fortwo 1.0 Micro Hybrid Drive passion',
'transmission': 'automatic',
'trim': 'Micro Hybrid Drive passion',
'year': 2008}
2026-04-27 08:13:23 [auto1.it] INFO: Saving data for WA05506: {'created_time': 1777277603.167443, 'last_price_update_time': 1777277603.167452, 'has_photos': True, 'auction_closing_time': 1777388967.0}
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_566bb675e95dd315ef4db871dfecf452.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8399410>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_fac0ebdf5b443184d50711df4116952a.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 68a44fbf-633a-5696-a4d4-d3398573fc86
2026-04-27 08:13:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-04-27 08:13:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590
2026-04-27 08:13:23 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 68a44fbf-633a-5696-a4d4-d3398573fc86 with identifier: KD87590 to the API
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:23 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': None,
'category': None,
'city': 'Varedo',
'color': 'white',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 92,
'expiration_date': '2026-04-28T15:51:34Z',
'fuel_type': 'diesel',
'id': '68a44fbf-633a-5696-a4d4-d3398573fc86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.5976,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD87590',
'listing': 'auction',
'location': 'IT, Varedo (MB)',
'location_confidence': 'geocoded',
'longitude': 9.1632,
'make': 'Peugeot',
'model': '208',
'odometer': 241530,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_fac0ebdf5b443184d50711df4116952a.jpg',
'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_0ddf67ab6981c94d45b0c9c0f67d6ae7.jpg',
'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_301646244ee2c1fc4eeb4b7b4f8690f5.jpg',
'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f581cc3d705f6583a7807d8eaa78fbdc.jpg',
'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f3d68ce601cbfa81cf7e63783222c4bc.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76578,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_fac0ebdf5b443184d50711df4116952a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_0ddf67ab6981c94d45b0c9c0f67d6ae7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56364,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f581cc3d705f6583a7807d8eaa78fbdc.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_68a44fbf-633a-5696-a4d4-d3398573fc86/68a44fbf-633a-5696-a4d4-d3398573fc86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71409,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img53/d2/53d23b43602bee35e9eef4284e647f71/pa/KD87590_f3d68ce601cbfa81cf7e63783222c4bc.jpg',
'Width': 800}],
'postal_code': '20814',
'price': 0,
'price_includes_vat': True,
'province': 'Monza e Brianza',
'province_code': 'IT-MB',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2013-05-09',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 208 1.6 HDi Allure',
'transmission': 'manual',
'trim': 'Allure',
'year': 2013}
2026-04-27 08:13:23 [auto1.it] INFO: Saving data for KD87590: {'created_time': 1777277603.680934, 'last_price_update_time': 1777277603.680943, 'has_photos': True, 'auction_closing_time': 1777391494.0}
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 68a44fbf-633a-5696-a4d4-d3398573fc86 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_d72744bb6546bc510c618d2349a7290b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0410>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_566bb675e95dd315ef4db871dfecf452.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead576a710>
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:23 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_d72744bb6546bc510c618d2349a7290b.jpg saved to cache
2026-04-27 08:13:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_134e68187c1a5d1be1c2e620b8315685.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58b94d0>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_134e68187c1a5d1be1c2e620b8315685.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_74d64331d8ffa29ac9b9e13ef0cf4f47.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item bb6042fe-d933-5d26-ac1a-04138888742a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564c210>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_74d64331d8ffa29ac9b9e13ef0cf4f47.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR29883> (referer: https://www.auto1.com/v1/car-details-view/VR29883/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e822642dfca77b884f058a5b8cc3bf8e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_f1393154346b126fe4a9daf16b6695a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26bae2f8-4a33-5adf-bec7-667edbf597ab with identifier: VR29883
2026-04-27 08:13:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26bae2f8-4a33-5adf-bec7-667edbf597ab with scrape type 1
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c403f6a8b099f3bf0e26ec94065c9117.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_72ef2cba2f4bd96e903f3005896c69b2.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_23615509788c6f4747d1f6670dad8ed7.jpg not downloaded yet
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5aaaa10>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e822642dfca77b884f058a5b8cc3bf8e.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_ea06023343107064d24bc045af65a0a2.jpg not downloaded yet
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57ad390>
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:24 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_f1393154346b126fe4a9daf16b6695a3.jpg saved to cache
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb6042fe-d933-5d26-ac1a-04138888742a
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c2965c697e6f8826ab7f8869376274a3.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c9ba042cbc57150d82674433c09acf88.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c4629efbd1fee6381204d24f7f31f011.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_8fdb3cfe633b0a9e20353ef458a66d89.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_7d2b240601a497965db44f6be315e289.jpg not downloaded yet
2026-04-27 08:13:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_11bc28f4f74d618c8a3c15895355e50e.jpg not downloaded yet
2026-04-27 08:13:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YK32497/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_11bc28f4f74d618c8a3c15895355e50e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4de6590>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_11bc28f4f74d618c8a3c15895355e50e.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item bb6042fe-d933-5d26-ac1a-04138888742a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_7d2b240601a497965db44f6be315e289.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fcb50>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_7d2b240601a497965db44f6be315e289.jpg saved to cache
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_8fdb3cfe633b0a9e20353ef458a66d89.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-04-27 08:13:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408
2026-04-27 08:13:25 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: bb6042fe-d933-5d26-ac1a-04138888742a with identifier: HZ95408 to the API
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:25 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:25 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 221,
'category': None,
'city': 'Padova',
'color': 'gray',
'currency': 'EUR',
'doors_number': 4,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 170,
'expiration_date': '2026-04-28T15:18:34Z',
'fuel_type': 'diesel',
'id': 'bb6042fe-d933-5d26-ac1a-04138888742a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HZ95408',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Ford',
'model': 'Tourneo Custom',
'odometer': 146510,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_f1393154346b126fe4a9daf16b6695a3.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_3d8575c3b950211c7bfae3257fa588d3.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e822642dfca77b884f058a5b8cc3bf8e.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_9954406b45e79c063b3ae20a59df4032.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_74d64331d8ffa29ac9b9e13ef0cf4f47.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_134e68187c1a5d1be1c2e620b8315685.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_d72744bb6546bc510c618d2349a7290b.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_630629a3c8d07e178ccbc012a781d8e7.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_566bb675e95dd315ef4db871dfecf452.jpg',
'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e598020c08f6c0f4021a37602508c46d.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98125,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_f1393154346b126fe4a9daf16b6695a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82137,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e822642dfca77b884f058a5b8cc3bf8e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74284,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_74d64331d8ffa29ac9b9e13ef0cf4f47.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81329,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_134e68187c1a5d1be1c2e620b8315685.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76775,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_d72744bb6546bc510c618d2349a7290b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83769,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_566bb675e95dd315ef4db871dfecf452.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_bb6042fe-d933-5d26-ac1a-04138888742a/bb6042fe-d933-5d26-ac1a-04138888742a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img1c/26/1c262a9873a3c152900ea467d1bccbf6/pa/HZ95408_e598020c08f6c0f4021a37602508c46d.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2022-10-12',
'seats_number': 3,
'seller_name': None,
'title': 'Ford Tourneo Custom 2.0 TDCi L1 Sport',
'transmission': 'automatic',
'trim': 'L1 Sport',
'year': 2022}
2026-04-27 08:13:25 [auto1.it] INFO: Saving data for HZ95408: {'created_time': 1777277605.97394, 'last_price_update_time': 1777277605.973953, 'has_photos': True, 'auction_closing_time': 1777389514.0}
2026-04-27 08:13:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c9ba042cbc57150d82674433c09acf88.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:25 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item bb6042fe-d933-5d26-ac1a-04138888742a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e41d0>
2026-04-27 08:13:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_8fdb3cfe633b0a9e20353ef458a66d89.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead555bb90>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c9ba042cbc57150d82674433c09acf88.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c2965c697e6f8826ab7f8869376274a3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551d050>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c2965c697e6f8826ab7f8869376274a3.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_ea06023343107064d24bc045af65a0a2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5837850>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_ea06023343107064d24bc045af65a0a2.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_23615509788c6f4747d1f6670dad8ed7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c403f6a8b099f3bf0e26ec94065c9117.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead551d390>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_23615509788c6f4747d1f6670dad8ed7.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5834410>
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:26 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c403f6a8b099f3bf0e26ec94065c9117.jpg saved to cache
2026-04-27 08:13:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab
2026-04-27 08:13:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 26bae2f8-4a33-5adf-bec7-667edbf597ab with identifier: VR29883
2026-04-27 08:13:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 26bae2f8-4a33-5adf-bec7-667edbf597ab with identifier: VR29883
2026-04-27 08:13:27 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 26bae2f8-4a33-5adf-bec7-667edbf597ab with identifier: VR29883 to the API
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:27 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:27 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 112,
'category': None,
'city': 'Milano',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.2L',
'engine_horse_power': 130,
'expiration_date': '2026-04-28T15:14:40Z',
'fuel_type': 'petrol',
'id': '26bae2f8-4a33-5adf-bec7-667edbf597ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR29883',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Peugeot',
'model': '308',
'odometer': 89882,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c403f6a8b099f3bf0e26ec94065c9117.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_72ef2cba2f4bd96e903f3005896c69b2.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_23615509788c6f4747d1f6670dad8ed7.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_ea06023343107064d24bc045af65a0a2.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c2965c697e6f8826ab7f8869376274a3.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c9ba042cbc57150d82674433c09acf88.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c4629efbd1fee6381204d24f7f31f011.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_8fdb3cfe633b0a9e20353ef458a66d89.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_7d2b240601a497965db44f6be315e289.jpg',
'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_11bc28f4f74d618c8a3c15895355e50e.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69873,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c403f6a8b099f3bf0e26ec94065c9117.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62646,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_23615509788c6f4747d1f6670dad8ed7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55500,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_ea06023343107064d24bc045af65a0a2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56047,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c2965c697e6f8826ab7f8869376274a3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62461,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_c9ba042cbc57150d82674433c09acf88.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75077,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_8fdb3cfe633b0a9e20353ef458a66d89.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_7d2b240601a497965db44f6be315e289.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_26bae2f8-4a33-5adf-bec7-667edbf597ab/26bae2f8-4a33-5adf-bec7-667edbf597ab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49403,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img19/83/1983560f4892d6429f4a2406bacbdb82/pa/VR29883_11bc28f4f74d618c8a3c15895355e50e.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-02-10',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 308 1.2 e-THP Allure',
'transmission': 'automatic',
'trim': 'Allure',
'year': 2016}
2026-04-27 08:13:28 [auto1.it] INFO: Saving data for VR29883: {'created_time': 1777277608.008541, 'last_price_update_time': 1777277608.008554, 'has_photos': True, 'auction_closing_time': 1777389280.0}
2026-04-27 08:13:28 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 26bae2f8-4a33-5adf-bec7-667edbf597ab due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH33587/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TR00137> (referer: https://www.auto1.com/v1/car-details-view/TR00137/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-04-27 08:13:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd with scrape type 1
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_28177f0f041ece398e3057b77fb995ac.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_0bf7fc781a58960e421f28af050e089d.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_6bfd7ac031b6972e96075ae455989427.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_e3af9f48f182cc0ab8e13d53db1e1c72.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_13b6064d8658c2c219eb361a1d339a94.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_65d3bbdbafcd4a6b032cdd182cab381a.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_140e6975b14e3ad200f6e053bda9fa8b.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_9eb16ba4d9be565b24a009e7ee8b7698.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_c1adf188ca71db977e78b74464104744.jpg not downloaded yet
2026-04-27 08:13:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_83fa3054a383fc420c46587340a4b558.jpg not downloaded yet
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG41904> (referer: https://www.auto1.com/v1/car-details-view/NG41904/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AR18622> (referer: https://www.auto1.com/v1/car-details-view/AR18622/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799b0d57-3c0b-5817-ab6d-d56885cce36b with identifier: NG41904
2026-04-27 08:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799b0d57-3c0b-5817-ab6d-d56885cce36b with scrape type 1
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 799b0d57-3c0b-5817-ab6d-d56885cce36b
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_6bab9c8725495022288b785f878d434a.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_5e40ca52c8c819494d038a8ccfd889fb.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_00331461d056611769dd995d36ca3d69.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_16f252e1d5fb1ef6b785674192e61fa3.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_f70078fce9e15b3ba14478a1d415596a.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-04-27 08:13:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d334019-d677-56c0-881f-92f4cf9d2c6f with scrape type 1
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg not downloaded yet
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_83fa3054a383fc420c46587340a4b558.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg not downloaded yet
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg not downloaded yet
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead839a550>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_83fa3054a383fc420c46587340a4b558.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead6486850>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ff310>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg saved to cache
2026-04-27 08:13:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a1c790>
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:31 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e5810>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65a2990>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c7290>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP15834/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567d1d0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_f70078fce9e15b3ba14478a1d415596a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a52cd0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_00331461d056611769dd995d36ca3d69.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549aad0>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545b290>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_f70078fce9e15b3ba14478a1d415596a.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799b0d57-3c0b-5817-ab6d-d56885cce36b
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548f090>
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:32 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_00331461d056611769dd995d36ca3d69.jpg saved to cache
2026-04-27 08:13:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799b0d57-3c0b-5817-ab6d-d56885cce36b
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_5e40ca52c8c819494d038a8ccfd889fb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-04-27 08:13:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622
2026-04-27 08:13:33 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 0d334019-d677-56c0-881f-92f4cf9d2c6f with identifier: AR18622 to the API
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:33 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:33 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 170,
'category': None,
'city': 'Milano',
'color': 'brown',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '2.0L',
'engine_horse_power': 185,
'expiration_date': '2026-04-28T15:16:40Z',
'fuel_type': 'diesel',
'id': '0d334019-d677-56c0-881f-92f4cf9d2c6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AR18622',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'Hyundai',
'model': 'Tucson',
'odometer': 166221,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_843af6c4a31759563c6951630727a011.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg',
'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_5aed5b716a2f47a786ae2fca9e4094f0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58226,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_ca1a2c8db4dfdea977a1266efb363920.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54550,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_518d2eb82894501e04b15530719bbe8f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61293,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_faa5df639c17060a0b8f0a26d97fbf2d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57808,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_63dfdf2e4fed9dce5ec2f06efe1c0bd6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54628,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_3c9e936725bd307bdf5716cff30fcf69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69102,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_8229345044c171f2b024198ecd112cfe.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66772,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_739a7de4a06237093bd4e425064cffea.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_0d334019-d677-56c0-881f-92f4cf9d2c6f/0d334019-d677-56c0-881f-92f4cf9d2c6f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56957,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgf1/2f/f12fbfad4f906f6ee189a0f5357744a8/pa/AR18622_b7b1f24c526ce1e1f1e1882bf323f4cb.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2016-06-06',
'seats_number': 5,
'seller_name': None,
'title': 'Hyundai Tucson 2.0 CRDi Xpossible 4WD',
'transmission': 'automatic',
'trim': 'Xpossible 4WD',
'year': 2016}
2026-04-27 08:13:33 [auto1.it] INFO: Saving data for AR18622: {'created_time': 1777277613.968025, 'last_price_update_time': 1777277613.968034, 'has_photos': True, 'auction_closing_time': 1777389400.0}
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 0d334019-d677-56c0-881f-92f4cf9d2c6f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_6bab9c8725495022288b785f878d434a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 799b0d57-3c0b-5817-ab6d-d56885cce36b due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead567c0d0>
2026-04-27 08:13:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_5e40ca52c8c819494d038a8ccfd889fb.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799b0d57-3c0b-5817-ab6d-d56885cce36b
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a00dd0>
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_6bab9c8725495022288b785f878d434a.jpg saved to cache
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799b0d57-3c0b-5817-ab6d-d56885cce36b
2026-04-27 08:13:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799b0d57-3c0b-5817-ab6d-d56885cce36b, skipping ID generation
2026-04-27 08:13:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799b0d57-3c0b-5817-ab6d-d56885cce36b with scrape type 1
2026-04-27 08:13:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799b0d57-3c0b-5817-ab6d-d56885cce36b sending to next pipeline
2026-04-27 08:13:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 799b0d57-3c0b-5817-ab6d-d56885cce36b, identifier: NG41904
2026-04-27 08:13:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 799b0d57-3c0b-5817-ab6d-d56885cce36b with identifier: NG41904
2026-04-27 08:13:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 799b0d57-3c0b-5817-ab6d-d56885cce36b with identifier: NG41904
2026-04-27 08:13:34 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 799b0d57-3c0b-5817-ab6d-d56885cce36b with identifier: NG41904 to the API
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:34 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_6bab9c8725495022288b785f878d434a.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 4',
'engine': '1.2L',
'engine_horse_power': 80,
'expiration_date': '2026-04-28T15:13:03Z',
'fuel_type': 'gas',
'id': '799b0d57-3c0b-5817-ab6d-d56885cce36b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG41904',
'listing': 'auction',
'location': 'IT, Roma',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Opel',
'model': 'Corsa',
'odometer': 153434,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76926,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_6bab9c8725495022288b785f878d434a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82287,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_5e40ca52c8c819494d038a8ccfd889fb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69508,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_00331461d056611769dd995d36ca3d69.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_799b0d57-3c0b-5817-ab6d-d56885cce36b/799b0d57-3c0b-5817-ab6d-d56885cce36b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41388,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imga8/2f/a82fa0633cfee7522f274fe2551d6e5c/pa/NG41904_f70078fce9e15b3ba14478a1d415596a.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2010-12-20',
'seats_number': 5,
'seller_name': None,
'title': 'Opel Corsa 1.2 LPG Edition',
'transmission': 'manual',
'trim': 'Edition',
'year': 2010}
2026-04-27 08:13:34 [auto1.it] INFO: Saving data for NG41904: {'created_time': 1777277614.557295, 'last_price_update_time': 1777277614.557306, 'has_photos': True, 'auction_closing_time': 1777389183.0}
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_140e6975b14e3ad200f6e053bda9fa8b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5508350>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_140e6975b14e3ad200f6e053bda9fa8b.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_65d3bbdbafcd4a6b032cdd182cab381a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_e3af9f48f182cc0ab8e13d53db1e1c72.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549b1d0>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_65d3bbdbafcd4a6b032cdd182cab381a.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559d3d0>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_e3af9f48f182cc0ab8e13d53db1e1c72.jpg saved to cache
2026-04-27 08:13:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_6bfd7ac031b6972e96075ae455989427.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_0bf7fc781a58960e421f28af050e089d.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_28177f0f041ece398e3057b77fb995ac.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559ecd0>
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:35 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_6bfd7ac031b6972e96075ae455989427.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54df290>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_0bf7fc781a58960e421f28af050e089d.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53379d0>
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_28177f0f041ece398e3057b77fb995ac.jpg saved to cache
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd
2026-04-27 08:13:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-04-27 08:13:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137
2026-04-27 08:13:36 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f76ce59d-c3f1-506f-8588-98d7ea04e6fd with identifier: TR00137 to the API
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:36 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:36 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 134,
'category': None,
'city': 'Bentivoglio',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '1.5L',
'engine_horse_power': 131,
'expiration_date': '2026-04-28T15:48:07Z',
'fuel_type': 'diesel',
'id': 'f76ce59d-c3f1-506f-8588-98d7ea04e6fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6369,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TR00137',
'listing': 'auction',
'location': 'IT, Bentivoglio (BO)',
'location_confidence': 'geocoded',
'longitude': 11.4174,
'make': 'Peugeot',
'model': '3008',
'odometer': 64516,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photo_urls': ['https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_28177f0f041ece398e3057b77fb995ac.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_0bf7fc781a58960e421f28af050e089d.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_6bfd7ac031b6972e96075ae455989427.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_e3af9f48f182cc0ab8e13d53db1e1c72.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_13b6064d8658c2c219eb361a1d339a94.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_65d3bbdbafcd4a6b032cdd182cab381a.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_140e6975b14e3ad200f6e053bda9fa8b.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_9eb16ba4d9be565b24a009e7ee8b7698.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_c1adf188ca71db977e78b74464104744.jpg',
'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_83fa3054a383fc420c46587340a4b558.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91645,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_28177f0f041ece398e3057b77fb995ac.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78185,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_0bf7fc781a58960e421f28af050e089d.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92894,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_6bfd7ac031b6972e96075ae455989427.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83050,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_e3af9f48f182cc0ab8e13d53db1e1c72.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91415,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_65d3bbdbafcd4a6b032cdd182cab381a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91871,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_140e6975b14e3ad200f6e053bda9fa8b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f76ce59d-c3f1-506f-8588-98d7ea04e6fd/f76ce59d-c3f1-506f-8588-98d7ea04e6fd_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64793,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgac/21/ac2190d40c10a1f9158c207d178ec084/pa/TR00137_83fa3054a383fc420c46587340a4b558.jpg',
'Width': 800}],
'postal_code': '40010',
'price': 0,
'price_includes_vat': True,
'province': 'Bologna',
'province_code': 'IT-BO',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2022-05-26',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 3008 1.5 Blue-HDi Allure Pack',
'transmission': 'automatic',
'trim': 'Allure Pack',
'year': 2022}
2026-04-27 08:13:36 [auto1.it] INFO: Saving data for TR00137: {'created_time': 1777277616.621425, 'last_price_update_time': 1777277616.621439, 'has_photos': True, 'auction_closing_time': 1777391287.0}
2026-04-27 08:13:36 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item f76ce59d-c3f1-506f-8588-98d7ea04e6fd due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HJ29626> (referer: https://www.auto1.com/v1/car-details-view/HJ29626/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-04-27 08:13:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d68be10-2f5e-597b-8605-04cb82f7d37d with scrape type 1
2026-04-27 08:13:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_567f3bec3b6ed6f55a6fb924300f8299.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_bcb8b68709a7890642b87adb8cbb0926.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_9a4f07ec5dfaa6e572a41dc8e88ef1e2.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_6d7bae168f4b8e6549eb7df1dfd00263.jpg not downloaded yet
2026-04-27 08:13:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_e05588fa9bbbea3ae37cf348cc7f22b9.jpg not downloaded yet
2026-04-27 08:13:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YK32497> (referer: https://www.auto1.com/v1/car-details-view/YK32497/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_e05588fa9bbbea3ae37cf348cc7f22b9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5122dfba-1c27-5616-a06b-b60f1d25e4b0 with identifier: YK32497
2026-04-27 08:13:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0 with scrape type 1
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_a3ec3e6badc6623feb78e366b126dcb6.jpg not downloaded yet
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_6d7bae168f4b8e6549eb7df1dfd00263.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_9762f4c0869b334d00764917fa06c776.jpg not downloaded yet
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_abd5a2cf475583b05b2f8c8e8ff430bd.jpg not downloaded yet
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_2ed2a27474a7ca6b5a7217c25d680b4c.jpg not downloaded yet
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_d168ffb7c8ca5c0cdb3afb09805beea7.jpg not downloaded yet
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54dcdd0>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_e05588fa9bbbea3ae37cf348cc7f22b9.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_a3ec3e6badc6623feb78e366b126dcb6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621fd0>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_6d7bae168f4b8e6549eb7df1dfd00263.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_d168ffb7c8ca5c0cdb3afb09805beea7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_2ed2a27474a7ca6b5a7217c25d680b4c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547d750>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_a3ec3e6badc6623feb78e366b126dcb6.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547cf10>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_d168ffb7c8ca5c0cdb3afb09805beea7.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5750>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_2ed2a27474a7ca6b5a7217c25d680b4c.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YH65644/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_abd5a2cf475583b05b2f8c8e8ff430bd.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead587ed10>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_abd5a2cf475583b05b2f8c8e8ff430bd.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0
2026-04-27 08:13:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_9a4f07ec5dfaa6e572a41dc8e88ef1e2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead559fd90>
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:40 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_9a4f07ec5dfaa6e572a41dc8e88ef1e2.jpg saved to cache
2026-04-27 08:13:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 5122dfba-1c27-5616-a06b-b60f1d25e4b0 with identifier: YK32497
2026-04-27 08:13:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 5122dfba-1c27-5616-a06b-b60f1d25e4b0 with identifier: YK32497
2026-04-27 08:13:41 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 5122dfba-1c27-5616-a06b-b60f1d25e4b0 with identifier: YK32497 to the API
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:41 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:41 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 136,
'category': None,
'city': 'Settimo Torinese',
'color': 'blue',
'currency': 'EUR',
'doors_number': 3,
'emission_standard': 'EURO 3',
'engine': '1.2L',
'engine_horse_power': 60,
'expiration_date': '2026-04-28T15:52:54Z',
'fuel_type': 'petrol',
'id': '5122dfba-1c27-5616-a06b-b60f1d25e4b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.1392,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YK32497',
'listing': 'auction',
'location': 'IT, Settimo Torinese',
'location_confidence': 'geocoded',
'longitude': 7.7701,
'make': 'Fiat',
'model': 'Punto',
'odometer': 114509,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photo_urls': ['https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_a3ec3e6badc6623feb78e366b126dcb6.jpg',
'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_9762f4c0869b334d00764917fa06c776.jpg',
'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_abd5a2cf475583b05b2f8c8e8ff430bd.jpg',
'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_2ed2a27474a7ca6b5a7217c25d680b4c.jpg',
'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_d168ffb7c8ca5c0cdb3afb09805beea7.jpg'],
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89591,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_a3ec3e6badc6623feb78e366b126dcb6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80203,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_abd5a2cf475583b05b2f8c8e8ff430bd.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63977,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_2ed2a27474a7ca6b5a7217c25d680b4c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_5122dfba-1c27-5616-a06b-b60f1d25e4b0/5122dfba-1c27-5616-a06b-b60f1d25e4b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75493,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img8c/86/8c860e39b04f9400c7023c0373921aed/pa/YK32497_d168ffb7c8ca5c0cdb3afb09805beea7.jpg',
'Width': 800}],
'postal_code': '10036',
'price': 0,
'price_includes_vat': True,
'province': 'Torino',
'province_code': 'IT-TO',
'region': 'Piemonte',
'region_code': 'IT-12',
'registration_date': '2005-01-13',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Punto 1.2 Actual',
'transmission': 'manual',
'trim': 'Actual',
'year': 2005}
2026-04-27 08:13:41 [auto1.it] INFO: Saving data for YK32497: {'created_time': 1777277621.946151, 'last_price_update_time': 1777277621.946195, 'has_photos': True, 'auction_closing_time': 1777391574.0}
2026-04-27 08:13:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_bcb8b68709a7890642b87adb8cbb0926.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:41 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 5122dfba-1c27-5616-a06b-b60f1d25e4b0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:13:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_567f3bec3b6ed6f55a6fb924300f8299.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56975d0>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_bcb8b68709a7890642b87adb8cbb0926.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5695290>
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_567f3bec3b6ed6f55a6fb924300f8299.jpg saved to cache
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d68be10-2f5e-597b-8605-04cb82f7d37d
2026-04-27 08:13:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d68be10-2f5e-597b-8605-04cb82f7d37d, skipping ID generation
2026-04-27 08:13:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d68be10-2f5e-597b-8605-04cb82f7d37d with scrape type 1
2026-04-27 08:13:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d68be10-2f5e-597b-8605-04cb82f7d37d sending to next pipeline
2026-04-27 08:13:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 9d68be10-2f5e-597b-8605-04cb82f7d37d, identifier: HJ29626
2026-04-27 08:13:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-04-27 08:13:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626
2026-04-27 08:13:42 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:13:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 9d68be10-2f5e-597b-8605-04cb82f7d37d with identifier: HJ29626 to the API
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:13:42 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:13:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_567f3bec3b6ed6f55a6fb924300f8299.jpg>
{'auction_title': '',
'c_o_2_emission_value': 122,
'category': None,
'city': 'Capua',
'color': 'black',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:10:01Z',
'fuel_type': 'diesel',
'id': '9d68be10-2f5e-597b-8605-04cb82f7d37d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ29626',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Fiat',
'model': 'Bravo',
'odometer': 284275,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59026,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_567f3bec3b6ed6f55a6fb924300f8299.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58525,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_bcb8b68709a7890642b87adb8cbb0926.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79529,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_9a4f07ec5dfaa6e572a41dc8e88ef1e2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47277,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_6d7bae168f4b8e6549eb7df1dfd00263.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_9d68be10-2f5e-597b-8605-04cb82f7d37d/9d68be10-2f5e-597b-8605-04cb82f7d37d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45242,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgfb/56/fb56a9b001e2aa81bdfdbef1f499785c/pa/HJ29626_e05588fa9bbbea3ae37cf348cc7f22b9.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2010-12-31',
'seats_number': 5,
'seller_name': None,
'title': 'Fiat Bravo 1.6 JTDM Multijet Dynamic',
'transmission': 'manual',
'trim': 'Multijet Dynamic',
'year': 2010}
2026-04-27 08:13:42 [auto1.it] INFO: Saving data for HJ29626: {'created_time': 1777277622.562422, 'last_price_update_time': 1777277622.562431, 'has_photos': True, 'auction_closing_time': 1777389001.0}
2026-04-27 08:13:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TJ53412/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XA59652> (referer: https://www.auto1.com/v1/car-details-view/XA59652/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with identifier: XA59652
2026-04-27 08:13:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with scrape type 1
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_db23fcff4b16fe1bfe05391a934b4158.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_d484b22f3dba97c486d7e1aee81ef52a.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_7467b4b8e2c5cb88e43cb432a6750d4c.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_2781921f0142a90814252636197e9eb8.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_8c788dbf5eff07dc386e51e8159a5277.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_7ef027c9b08ef1e440bf9863a32bce4e.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_b2984b4b78b56362c646c5540a97d876.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_48b75c28a4af19d001d52050138a37c9.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_697088028d05f6afab660326ad7b6b3e.jpg not downloaded yet
2026-04-27 08:13:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_27f9f8a84254ffba7216c831adcfdd65.jpg not downloaded yet
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RJ39648/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_27f9f8a84254ffba7216c831adcfdd65.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead53bac10>
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:13:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:13:58 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_27f9f8a84254ffba7216c831adcfdd65.jpg saved to cache
2026-04-27 08:13:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH33587> (referer: https://www.auto1.com/v1/car-details-view/KH33587/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:13:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:13:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f564d25b-dc48-55fb-beba-bb8948c756e3 with identifier: KH33587
2026-04-27 08:13:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f564d25b-dc48-55fb-beba-bb8948c756e3 with scrape type 1
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a87319fd8e20f08e05239766d15c88d7.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_9f2c0a414a3fae8fe93a86d10feca244.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_9cdbebc54acdba80a1dfedf1faafe475.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_397c2b969b118e4575093039793dd2a7.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_17ce2245ebc449d52b0d92ff4f177d2c.jpg not downloaded yet
2026-04-27 08:13:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5d0bb94e8654cc237d0a00d84c5ff838.jpg not downloaded yet
2026-04-27 08:13:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_697088028d05f6afab660326ad7b6b3e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a1f47cbe850bbf5e27aa765489bcf084.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_870841d759c03e27cbd705fb6ae39453.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_79eaf8a3a9959ebf4ca025f3c10b8b97.jpg not downloaded yet
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5e3adb2e2c3b132226ed0f1a2aa72b18.jpg not downloaded yet
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f7ed0>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_697088028d05f6afab660326ad7b6b3e.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5d0bb94e8654cc237d0a00d84c5ff838.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0550>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5d0bb94e8654cc237d0a00d84c5ff838.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5e3adb2e2c3b132226ed0f1a2aa72b18.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5458d50>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5e3adb2e2c3b132226ed0f1a2aa72b18.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_79eaf8a3a9959ebf4ca025f3c10b8b97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7feae4b04c50>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_79eaf8a3a9959ebf4ca025f3c10b8b97.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_870841d759c03e27cbd705fb6ae39453.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead54b1950>
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:00 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_870841d759c03e27cbd705fb6ae39453.jpg saved to cache
2026-04-27 08:14:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a1f47cbe850bbf5e27aa765489bcf084.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead549b4d0>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a1f47cbe850bbf5e27aa765489bcf084.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_17ce2245ebc449d52b0d92ff4f177d2c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BL12748/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56ff650>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_17ce2245ebc449d52b0d92ff4f177d2c.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_397c2b969b118e4575093039793dd2a7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a01350>
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:01 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_397c2b969b118e4575093039793dd2a7.jpg saved to cache
2026-04-27 08:14:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item f564d25b-dc48-55fb-beba-bb8948c756e3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_9f2c0a414a3fae8fe93a86d10feca244.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a87319fd8e20f08e05239766d15c88d7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5620890>
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_9f2c0a414a3fae8fe93a86d10feca244.jpg saved to cache
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5498410>
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a87319fd8e20f08e05239766d15c88d7.jpg saved to cache
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f564d25b-dc48-55fb-beba-bb8948c756e3
2026-04-27 08:14:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f564d25b-dc48-55fb-beba-bb8948c756e3, skipping ID generation
2026-04-27 08:14:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f564d25b-dc48-55fb-beba-bb8948c756e3 with scrape type 1
2026-04-27 08:14:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f564d25b-dc48-55fb-beba-bb8948c756e3 sending to next pipeline
2026-04-27 08:14:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: f564d25b-dc48-55fb-beba-bb8948c756e3, identifier: KH33587
2026-04-27 08:14:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: f564d25b-dc48-55fb-beba-bb8948c756e3 with identifier: KH33587
2026-04-27 08:14:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: f564d25b-dc48-55fb-beba-bb8948c756e3 with identifier: KH33587
2026-04-27 08:14:02 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: f564d25b-dc48-55fb-beba-bb8948c756e3 with identifier: KH33587 to the API
2026-04-27 08:14:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a87319fd8e20f08e05239766d15c88d7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'category': None,
'city': 'Roma',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.0L',
'engine_horse_power': 115,
'expiration_date': '2026-04-28T15:11:46Z',
'fuel_type': 'petrol',
'id': 'f564d25b-dc48-55fb-beba-bb8948c756e3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.8919,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH33587',
'listing': 'auction',
'location': 'IT, Roma RM',
'location_confidence': 'geocoded',
'longitude': 12.5113,
'make': 'Audi',
'model': 'Q2',
'odometer': 134828,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56612,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a87319fd8e20f08e05239766d15c88d7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54499,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_9f2c0a414a3fae8fe93a86d10feca244.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53095,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_397c2b969b118e4575093039793dd2a7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53482,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_17ce2245ebc449d52b0d92ff4f177d2c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57339,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5d0bb94e8654cc237d0a00d84c5ff838.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46452,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_a1f47cbe850bbf5e27aa765489bcf084.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59463,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_870841d759c03e27cbd705fb6ae39453.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59215,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_79eaf8a3a9959ebf4ca025f3c10b8b97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_f564d25b-dc48-55fb-beba-bb8948c756e3/f564d25b-dc48-55fb-beba-bb8948c756e3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42725,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img81/26/8126971e081d11e5ca701ac0a3862c48/pa/KH33587_5e3adb2e2c3b132226ed0f1a2aa72b18.jpg',
'Width': 800}],
'postal_code': '00118',
'price': 0,
'price_includes_vat': True,
'province': 'Roma',
'province_code': 'IT-RM',
'region': 'Lazio',
'region_code': 'IT-07',
'registration_date': '2018-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'Audi Q2 1.0 TFSI ultra',
'transmission': 'manual',
'trim': 'ultra',
'year': 2018}
2026-04-27 08:14:03 [auto1.it] INFO: Saving data for KH33587: {'created_time': 1777277643.181446, 'last_price_update_time': 1777277643.181455, 'has_photos': True, 'auction_closing_time': 1777389106.0}
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_48b75c28a4af19d001d52050138a37c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZK87486/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a95190>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_48b75c28a4af19d001d52050138a37c9.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_b2984b4b78b56362c646c5540a97d876.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547e4d0>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_b2984b4b78b56362c646c5540a97d876.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_8c788dbf5eff07dc386e51e8159a5277.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a01fd0>
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:03 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_8c788dbf5eff07dc386e51e8159a5277.jpg saved to cache
2026-04-27 08:14:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZT54121/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_2781921f0142a90814252636197e9eb8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a97390>
2026-04-27 08:14:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:04 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_2781921f0142a90814252636197e9eb8.jpg saved to cache
2026-04-27 08:14:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-04-27 08:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_d484b22f3dba97c486d7e1aee81ef52a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_db23fcff4b16fe1bfe05391a934b4158.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead8398610>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_d484b22f3dba97c486d7e1aee81ef52a.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548c2d0>
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_db23fcff4b16fe1bfe05391a934b4158.jpg saved to cache
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3
2026-04-27 08:14:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3, skipping ID generation
2026-04-27 08:14:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with scrape type 1
2026-04-27 08:14:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 sending to next pipeline
2026-04-27 08:14:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3, identifier: XA59652
2026-04-27 08:14:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with identifier: XA59652
2026-04-27 08:14:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with identifier: XA59652
2026-04-27 08:14:05 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: ae9fecfa-dfcf-59bc-8e8b-c46966b975f3 with identifier: XA59652 to the API
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:05 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_db23fcff4b16fe1bfe05391a934b4158.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'category': 'Rental',
'city': 'Capua',
'color': 'silver',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:42:45Z',
'fuel_type': 'diesel',
'id': 'ae9fecfa-dfcf-59bc-8e8b-c46966b975f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 41.1052,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XA59652',
'listing': 'auction',
'location': 'IT, Capua',
'location_confidence': 'geocoded',
'longitude': 14.2127,
'make': 'Skoda',
'model': 'Octavia',
'odometer': 311259,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71983,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_db23fcff4b16fe1bfe05391a934b4158.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71160,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_d484b22f3dba97c486d7e1aee81ef52a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61748,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_2781921f0142a90814252636197e9eb8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67672,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_8c788dbf5eff07dc386e51e8159a5277.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53807,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_b2984b4b78b56362c646c5540a97d876.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70051,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_48b75c28a4af19d001d52050138a37c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65594,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_697088028d05f6afab660326ad7b6b3e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_ae9fecfa-dfcf-59bc-8e8b-c46966b975f3/ae9fecfa-dfcf-59bc-8e8b-c46966b975f3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81214,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img2b/dc/2bdcc304fb176d9a214dff3db6d1ce5f/pa/XA59652_27f9f8a84254ffba7216c831adcfdd65.jpg',
'Width': 800}],
'postal_code': '81043',
'price': 0,
'price_includes_vat': True,
'province': 'Caserta',
'province_code': 'IT-CE',
'region': 'Campania',
'region_code': 'IT-04',
'registration_date': '2013-10-14',
'seats_number': 5,
'seller_name': None,
'title': 'Skoda Octavia 2.0 TDI Executive',
'transmission': 'automatic',
'trim': 'Executive',
'year': 2013}
2026-04-27 08:14:06 [auto1.it] INFO: Saving data for XA59652: {'created_time': 1777277646.082406, 'last_price_update_time': 1777277646.08242, 'has_photos': True, 'auction_closing_time': 1777390965.0}
2026-04-27 08:14:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BA18808/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:10 [scrapy.extensions.logstats] INFO: Crawled 674 pages (at 27 pages/min), scraped 295 items (at 15 items/min)
2026-04-27 08:14:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:14:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YH65644> (referer: https://www.auto1.com/v1/car-details-view/YH65644/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d0b04267-9a05-5c77-aae0-02ede1051de1 with identifier: YH65644
2026-04-27 08:14:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b04267-9a05-5c77-aae0-02ede1051de1 with scrape type 1
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_c2f89bbd74a7bade520739de9dc6711e.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_cff4c27084052d8e1e2b1639aaac98c5.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_be253d33f31777d9c5e3a7958b1482cb.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0694ead76ae306618306461f91860e6e.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ee4d9a84e8d70cc558f78089f3083e5a.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0c54fba7f5b75809b0606e7382d54cec.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_38a968b4d3d64d683f5683032639964c.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ad403bd84f7b6a566c108cd56159955b.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_f1439aa6bdc11b987e4007e3bdc42096.jpg not downloaded yet
2026-04-27 08:14:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_26d95ba17772ed7ede47be2122ed3c5c.jpg not downloaded yet
2026-04-27 08:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CH57824/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_26d95ba17772ed7ede47be2122ed3c5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_f1439aa6bdc11b987e4007e3bdc42096.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64c2110>
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_26d95ba17772ed7ede47be2122ed3c5c.jpg saved to cache
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56fcc50>
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:47 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_f1439aa6bdc11b987e4007e3bdc42096.jpg saved to cache
2026-04-27 08:14:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TJ53412> (referer: https://www.auto1.com/v1/car-details-view/TJ53412/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ad403bd84f7b6a566c108cd56159955b.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efc80752-619c-5831-a6de-ef6e371dbdd5 with identifier: TJ53412
2026-04-27 08:14:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc80752-619c-5831-a6de-ef6e371dbdd5 with scrape type 1
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_72066b48a1d54cd149d000acf686b163.jpg not downloaded yet
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_38a968b4d3d64d683f5683032639964c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_c4c52ca8796b4099eadd5b9151d5bd37.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_bf3dc351489a45f2dbf93021f4214520.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_8fc06f2c4e64f2bd873a18db15bb8b41.jpg not downloaded yet
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_06bf93282c0705b54f2176223fea4fdc.jpg not downloaded yet
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead65c50d0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ad403bd84f7b6a566c108cd56159955b.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_72066b48a1d54cd149d000acf686b163.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5953dd0>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_38a968b4d3d64d683f5683032639964c.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_06bf93282c0705b54f2176223fea4fdc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5951310>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_72066b48a1d54cd149d000acf686b163.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead547fc90>
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:51 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_06bf93282c0705b54f2176223fea4fdc.jpg saved to cache
2026-04-27 08:14:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_8fc06f2c4e64f2bd873a18db15bb8b41.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c4410>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_8fc06f2c4e64f2bd873a18db15bb8b41.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_bf3dc351489a45f2dbf93021f4214520.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_c4c52ca8796b4099eadd5b9151d5bd37.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0c54fba7f5b75809b0606e7382d54cec.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d1d90>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_bf3dc351489a45f2dbf93021f4214520.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ee4d9a84e8d70cc558f78089f3083e5a.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5621e10>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_c4c52ca8796b4099eadd5b9151d5bd37.jpg saved to cache
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efc80752-619c-5831-a6de-ef6e371dbdd5
2026-04-27 08:14:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efc80752-619c-5831-a6de-ef6e371dbdd5, skipping ID generation
2026-04-27 08:14:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efc80752-619c-5831-a6de-ef6e371dbdd5 with scrape type 1
2026-04-27 08:14:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efc80752-619c-5831-a6de-ef6e371dbdd5 sending to next pipeline
2026-04-27 08:14:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efc80752-619c-5831-a6de-ef6e371dbdd5, identifier: TJ53412
2026-04-27 08:14:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efc80752-619c-5831-a6de-ef6e371dbdd5 with identifier: TJ53412
2026-04-27 08:14:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efc80752-619c-5831-a6de-ef6e371dbdd5 with identifier: TJ53412
2026-04-27 08:14:52 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efc80752-619c-5831-a6de-ef6e371dbdd5 with identifier: TJ53412 to the API
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_c4c52ca8796b4099eadd5b9151d5bd37.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'category': 'Rental',
'city': 'Padova',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 5',
'engine': '2.0L',
'engine_horse_power': 140,
'expiration_date': '2026-04-28T15:00:13Z',
'fuel_type': 'diesel',
'id': 'efc80752-619c-5831-a6de-ef6e371dbdd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.408,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TJ53412',
'listing': 'auction',
'location': 'IT, Padova',
'location_confidence': 'geocoded',
'longitude': 11.8859,
'make': 'Ford',
'model': 'Kuga',
'odometer': 278237,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 5,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73939,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_72066b48a1d54cd149d000acf686b163.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70588,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_c4c52ca8796b4099eadd5b9151d5bd37.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75222,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_bf3dc351489a45f2dbf93021f4214520.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_8fc06f2c4e64f2bd873a18db15bb8b41.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efc80752-619c-5831-a6de-ef6e371dbdd5/efc80752-619c-5831-a6de-ef6e371dbdd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53825,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgdb/2b/db2b06f4b87351d22c151b16a541d6e0/pa/TJ53412_06bf93282c0705b54f2176223fea4fdc.jpg',
'Width': 800}],
'postal_code': '35100',
'price': 0,
'price_includes_vat': True,
'province': 'Padova',
'province_code': 'IT-PD',
'region': 'Veneto',
'region_code': 'IT-20',
'registration_date': '2010-07-05',
'seats_number': 5,
'seller_name': None,
'title': 'Ford Kuga 2.0 TDCi Titanium',
'transmission': 'manual',
'trim': 'Titanium',
'year': 2010}
2026-04-27 08:14:52 [auto1.it] INFO: Saving data for TJ53412: {'created_time': 1777277692.927742, 'last_price_update_time': 1777277692.927754, 'has_photos': True, 'auction_closing_time': 1777388413.0}
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0694ead76ae306618306461f91860e6e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RJ39648> (referer: https://www.auto1.com/v1/car-details-view/RJ39648/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c4490>
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:52 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0c54fba7f5b75809b0606e7382d54cec.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead64f08d0>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ee4d9a84e8d70cc558f78089f3083e5a.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_be253d33f31777d9c5e3a7958b1482cb.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead563d950>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0694ead76ae306618306461f91860e6e.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_c2f89bbd74a7bade520739de9dc6711e.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb6381f-5238-5efa-899b-383bf2626259 with identifier: RJ39648
2026-04-27 08:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb6381f-5238-5efa-899b-383bf2626259 with scrape type 1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_4b587cbf4db7c0635acbbc0697aa006f.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_9899eeafdee149e006fc420f06f8d070.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_75787dfc429fa5ba696725e8d779b8c9.jpg not downloaded yet
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c2050>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_be253d33f31777d9c5e3a7958b1482cb.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_b475223acbf81c96c1dfc943e25288f6.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_6aec4560704591a0cdaa3d89878235d3.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_a61015091ce4bb9eb5a19495738885ca.jpg not downloaded yet
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead564f710>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_c2f89bbd74a7bade520739de9dc6711e.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_5e67290abe69e81a0dfc31cf3b246cbc.jpg not downloaded yet
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_cff4c27084052d8e1e2b1639aaac98c5.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ad9b468e4365b186560a215d6a825a97.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_815518943b23a07c2d59d8895359142f.jpg not downloaded yet
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ee0a241febbfb3605d49091a4fedcf60.jpg not downloaded yet
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5559c50>
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_cff4c27084052d8e1e2b1639aaac98c5.jpg saved to cache
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d0b04267-9a05-5c77-aae0-02ede1051de1
2026-04-27 08:14:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d0b04267-9a05-5c77-aae0-02ede1051de1, skipping ID generation
2026-04-27 08:14:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d0b04267-9a05-5c77-aae0-02ede1051de1 with scrape type 1
2026-04-27 08:14:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d0b04267-9a05-5c77-aae0-02ede1051de1 sending to next pipeline
2026-04-27 08:14:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: d0b04267-9a05-5c77-aae0-02ede1051de1, identifier: YH65644
2026-04-27 08:14:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: d0b04267-9a05-5c77-aae0-02ede1051de1 with identifier: YH65644
2026-04-27 08:14:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: d0b04267-9a05-5c77-aae0-02ede1051de1 with identifier: YH65644
2026-04-27 08:14:53 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: d0b04267-9a05-5c77-aae0-02ede1051de1 with identifier: YH65644 to the API
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:53 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_cff4c27084052d8e1e2b1639aaac98c5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 194,
'category': None,
'city': 'Milano',
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6D',
'engine': '2.0L',
'engine_horse_power': 231,
'expiration_date': '2026-04-28T15:59:12Z',
'fuel_type': 'diesel',
'id': 'd0b04267-9a05-5c77-aae0-02ede1051de1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 45.4643,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH65644',
'listing': 'auction',
'location': 'IT, Milano',
'location_confidence': 'geocoded',
'longitude': 9.1895,
'make': 'BMW',
'model': 'X5',
'odometer': 219643,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84343,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_c2f89bbd74a7bade520739de9dc6711e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80689,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_cff4c27084052d8e1e2b1639aaac98c5.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71640,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_be253d33f31777d9c5e3a7958b1482cb.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47795,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0694ead76ae306618306461f91860e6e.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ee4d9a84e8d70cc558f78089f3083e5a.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74260,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_0c54fba7f5b75809b0606e7382d54cec.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50059,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_38a968b4d3d64d683f5683032639964c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68605,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_ad403bd84f7b6a566c108cd56159955b.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80987,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_f1439aa6bdc11b987e4007e3bdc42096.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_d0b04267-9a05-5c77-aae0-02ede1051de1/d0b04267-9a05-5c77-aae0-02ede1051de1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74641,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img49/5b/495bf1f9c6a99c83bd12fa076c5c12a7/pa/YH65644_26d95ba17772ed7ede47be2122ed3c5c.jpg',
'Width': 800}],
'postal_code': '20121',
'price': 0,
'price_includes_vat': True,
'province': 'Milano',
'province_code': 'IT-MI',
'region': 'Lombardia',
'region_code': 'IT-09',
'registration_date': '2021-06-22',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X5 xDrive 25d M Sport',
'transmission': 'automatic',
'trim': 'M Sport',
'year': 2021}
2026-04-27 08:14:53 [auto1.it] INFO: Saving data for YH65644: {'created_time': 1777277693.932482, 'last_price_update_time': 1777277693.932545, 'has_photos': True, 'auction_closing_time': 1777391952.0}
2026-04-27 08:14:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_5e67290abe69e81a0dfc31cf3b246cbc.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58151d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_5e67290abe69e81a0dfc31cf3b246cbc.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ee0a241febbfb3605d49091a4fedcf60.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead548d510>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ee0a241febbfb3605d49091a4fedcf60.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_815518943b23a07c2d59d8895359142f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5a2a110>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_815518943b23a07c2d59d8895359142f.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ad9b468e4365b186560a215d6a825a97.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55590d0>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ad9b468e4365b186560a215d6a825a97.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_a61015091ce4bb9eb5a19495738885ca.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead56c5390>
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:54 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_a61015091ce4bb9eb5a19495738885ca.jpg saved to cache
2026-04-27 08:14:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_6aec4560704591a0cdaa3d89878235d3.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BL12748> (referer: https://www.auto1.com/v1/car-details-view/BL12748/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-04-27 08:14:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649f110>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_6aec4560704591a0cdaa3d89878235d3.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-04-27 08:14:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with scrape type 1
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg not downloaded yet
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_75787dfc429fa5ba696725e8d779b8c9.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg not downloaded yet
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_b475223acbf81c96c1dfc943e25288f6.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg not downloaded yet
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg not downloaded yet
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg not downloaded yet
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c0f50>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_75787dfc429fa5ba696725e8d779b8c9.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5810>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_b475223acbf81c96c1dfc943e25288f6.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead550a450>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_3.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead649df50>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f4d10>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_8.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5696b50>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_7.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead545bc10>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_9.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0c90>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_6.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead5509690>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_4.jpg HTTP/1.1" 201 0
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg saved to cache
2026-04-27 08:14:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead58d0f90>
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:55 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_5.jpg HTTP/1.1" 201 0
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg saved to cache
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_9899eeafdee149e006fc420f06f8d070.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead55c19d0>
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg saved to cache
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_4b587cbf4db7c0635acbbc0697aa006f.jpg> (referer: https://www.auto1.com/)
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57e4090>
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_1.jpg HTTP/1.1" 201 0
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_9899eeafdee149e006fc420f06f8d070.jpg saved to cache
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead59f5a10>
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_2.jpg HTTP/1.1" 201 0
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg saved to cache
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef
2026-04-27 08:14:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef, skipping ID generation
2026-04-27 08:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with scrape type 1
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2bf212b9-e1b8-57c0-9e7b-978bd89960ef sending to next pipeline
2026-04-27 08:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef, identifier: BL12748
2026-04-27 08:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-04-27 08:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748
2026-04-27 08:14:56 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: 2bf212b9-e1b8-57c0-9e7b-978bd89960ef with identifier: BL12748 to the API
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg>
{'auction_title': '',
'c_o_2_emission_value': 96,
'category': None,
'city': 'Reggio Emilia',
'color': 'gray',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6B',
'engine': '1.6L',
'engine_horse_power': 120,
'expiration_date': '2026-04-28T15:18:44Z',
'fuel_type': 'diesel',
'id': '2bf212b9-e1b8-57c0-9e7b-978bd89960ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'latitude': 44.6983,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BL12748',
'listing': 'auction',
'location': 'IT, Reggio Emilia',
'location_confidence': 'geocoded',
'longitude': 10.6312,
'make': 'Peugeot',
'model': '2008',
'odometer': 33835,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 15,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69679,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_132dfd49da3a9cb70cbf054b8996f0b0.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67511,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_51df954e4b45d2bb562cca060469c839.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67634,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_6a148500a756b094ca9d555e7655cf04.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58609,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_3aa28b2622c5c619488c8413fa9df6e8.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62116,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_46f596026f6c6214bea8147e33368f67.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67709,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_4904efe0d6f26894d45ad71f47933ec7.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58948,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_622a97ba4f5cc7ae7d997047abb3eb5c.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70412,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_e306414df04bbf0feabcbf71158bfde2.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68831,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_ee410d645c4cae5b5c4df86001431062.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_2bf212b9-e1b8-57c0-9e7b-978bd89960ef/2bf212b9-e1b8-57c0-9e7b-978bd89960ef_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51162,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/imgb3/fa/b3fa91bb5a4a0d0c68c017dc330271f0/pa/BL12748_1fb8a762f0c1ac1c9b3d2d2fa5309b31.jpg',
'Width': 800}],
'postal_code': '42100',
'price': 0,
'price_includes_vat': True,
'province': "Reggio Nell'Emilia",
'province_code': 'IT-RE',
'region': 'Emilia-Romagna',
'region_code': 'IT-05',
'registration_date': '2017-03-14',
'seats_number': 5,
'seller_name': None,
'title': 'Peugeot 2008 1.6 Blue-HDi GT Line',
'transmission': 'manual',
'trim': 'GT Line',
'year': 2017}
2026-04-27 08:14:56 [auto1.it] INFO: Saving data for BL12748: {'created_time': 1777277696.777903, 'last_price_update_time': 1777277696.777915, 'has_photos': True, 'auction_closing_time': 1777389524.0}
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fead57c4bd0>
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-04-27 08:14:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-04-27 08:14:56 [urllib3.connectionpool] DEBUG: https://alxdev.blob.core.windows.net:443 "PUT /top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_0.jpg HTTP/1.1" 201 0
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_4b587cbf4db7c0635acbbc0697aa006f.jpg saved to cache
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item efb6381f-5238-5efa-899b-383bf2626259
2026-04-27 08:14:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: efb6381f-5238-5efa-899b-383bf2626259, skipping ID generation
2026-04-27 08:14:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb6381f-5238-5efa-899b-383bf2626259 with scrape type 1
2026-04-27 08:14:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item efb6381f-5238-5efa-899b-383bf2626259 sending to next pipeline
2026-04-27 08:14:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.it, Processed item id: efb6381f-5238-5efa-899b-383bf2626259, identifier: RJ39648
2026-04-27 08:14:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.it, Translating item: efb6381f-5238-5efa-899b-383bf2626259 with identifier: RJ39648
2026-04-27 08:14:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.it, Applying rules to item: efb6381f-5238-5efa-899b-383bf2626259 with identifier: RJ39648
2026-04-27 08:14:57 [crawlers.pipelines.geocoding_pipeline] INFO: geocoding.decision
2026-04-27 08:14:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.it, Posting item: efb6381f-5238-5efa-899b-383bf2626259 with identifier: RJ39648 to the API
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.alx.dev-cluster.alx.tech:443
2026-04-27 08:14:57 [urllib3.connectionpool] DEBUG: https://api.alx.dev-cluster.alx.tech:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-04-27 08:14:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_4b587cbf4db7c0635acbbc0697aa006f.jpg>
{'auction_title': '',
'c_o_2_emission_value': 152,
'category': None,
'city': None,
'color': 'white',
'currency': 'EUR',
'doors_number': 5,
'emission_standard': 'EURO 6',
'engine': '1.5L',
'engine_horse_power': 150,
'expiration_date': '2026-04-28T15:14:16Z',
'fuel_type': 'petrol',
'id': 'efb6381f-5238-5efa-899b-383bf2626259',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': True,
'latitude': None,
'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RJ39648',
'listing': 'auction',
'location': 'IT',
'location_confidence': None,
'longitude': None,
'make': 'Cupra',
'model': 'Formentor',
'odometer': 38890,
'odometer_reading_unit': 'km',
'origin_country_code': 'IT',
'original_photo_count': 14,
'photos': [{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_4b587cbf4db7c0635acbbc0697aa006f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106256,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_9899eeafdee149e006fc420f06f8d070.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90317,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_75787dfc429fa5ba696725e8d779b8c9.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86893,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_b475223acbf81c96c1dfc943e25288f6.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97194,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_6aec4560704591a0cdaa3d89878235d3.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103016,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_a61015091ce4bb9eb5a19495738885ca.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 3392774,
'Height': 3024,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_5e67290abe69e81a0dfc31cf3b246cbc.jpg',
'Width': 4032},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106196,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ad9b468e4365b186560a215d6a825a97.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72414,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_815518943b23a07c2d59d8895359142f.jpg',
'Width': 800},
{'BlobStorageUrl': 'https://alxdev.blob.core.windows.net/top-deal-listing/listing_efb6381f-5238-5efa-899b-383bf2626259/efb6381f-5238-5efa-899b-383bf2626259_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76291,
'Height': 600,
'OriginUrl': 'https://img-pa.auto1.com/img38/7b/387b4ecd1921b2187e4882c7dea4de14/pa/RJ39648_ee0a241febbfb3605d49091a4fedcf60.jpg',
'Width': 800}],
'postal_code': None,
'price': 0,
'price_includes_vat': True,
'province': None,
'province_code': None,
'region': None,
'region_code': None,
'registration_date': '2024-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'Cupra Formentor 1.5 TSI ACT',
'transmission': 'automatic',
'trim': '',
'year': 2024}
2026-04-27 08:14:57 [auto1.it] INFO: Saving data for RJ39648: {'created_time': 1777277697.281183, 'last_price_update_time': 1777277697.281193, 'has_photos': True, 'auction_closing_time': 1777389256.0}
2026-04-27 08:15:10 [scrapy.extensions.logstats] INFO: Crawled 679 pages (at 5 pages/min), scraped 299 items (at 4 items/min)
2026-04-27 08:15:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 395MiB
2026-04-27 08:15:14 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.404(s), this was the 1st time calling it.
2026-04-27 08:15:14 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.499056265624668 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:35 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.132(s), this was the 1st time calling it.
2026-04-27 08:15:35 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 6.485317581470984 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:39 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.217(s), this was the 1st time calling it.
2026-04-27 08:15:39 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 4.820283006924289 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:43 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 130.951(s), this was the 1st time calling it.
2026-04-27 08:15:43 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.786757861378092 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-04-27 08:15:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-04-27 08:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.